Let ABCD be the rectangle of maximum area with sides AB=2x and BC=2y, where C(x,y) is a point on the ellipse a2x2+b2y2=1 as shown in the figure. The area A of the rectangle is 4xy i.e., A=4xy which gives A2=16x2y2=s (say)
Therefore, s=16x2(1−a2x2)⋅b2=a216b2(a2x2−x4) ⇒dxds=a216b2⋅[2a2x−4x3]
Again, dxds=0⇒x=2a and y=2b
Now, dx2d2s=a216b2[2a2−12x2]
At x=2a,dx2d2s=a216b2[2a2−6a2] =a216b2(−4a2)<0
Thus at x=2a,y=2b,s is maximum and hence the area A is maximum.
Maximum area =4⋅x⋅y⋅=4⋅2a⋅2b=2ab sq units.