R2=(3P)2+(2P)2+2(3P)(2P)cosθ ⇒R2=13P2+12P2cosθ…(1)
When the first force is doubled, the resultant is doubled,
so, (2R)2=(6P)2+(2P)2+2(6P)(2P)cosθ ⇒4R2=36P2+4P2+24P2cosθ ⇒R2=10P2+6P2cosθ…(2)
Equating (1) & (2), we get 13P2+12P2cosθ=10P2+6P2cosθ 3P2=−6P2cosθ
so, cosθ=−21 ⇒θ=120∘