To find the coefficient of x3 and x4, use the formula of coefficient of xr in (1−x)n is (−1)rnCrand then simplify
. In expansion of (1+ax+bx2)(1−2x)18
Coefficient of x3 = Coefficient of x3 in (1−2x)18 + Coefficient of x2 in a (1−2x)18 + Coefficient of x in b(1−2x)18 =−18C3.23+a18Ca.22−b18C1.2
Given, coefficient of x3=0 ⇒18C3.23+a18C2.22−b18C1.2=0 ⇒−3×218×17×16.8+a.218×1722−b.18.2=0 ⇒17a−b=334×16....(i)
Similarly, coefficient of x4=0 ⇒18C4.24−a.18C323+b.18C2.22=0 ∴32a−3b=240.......(ii)
On solving Eqs. (i) and (ii), we get a=16,b=3272