Equation of plane OAB is given by, ∣∣x−01−02−0y−02−01−0z−01−03−0∣∣=0⇒∣∣x12y21z13∣∣=0 x(6−1)−y(3−2)+z(1−4)=0 5x−y−3z=0
Equation of plane ABC is given by, ∣∣x−12−1−1−1y−21−21−2z−13−12−1∣∣=0 ∣∣x−11−2y−2−1−1z−121∣∣=0 (x−1)(−1+2)−(y−2)(1+4)+(z−1)(−1−2)=0 x−1−5y+10−3z+3=0 x−5y−3z+12=0… (ii)
Then angle between planes represented by Eqs. (i) and (ii) is given by, cosθ=25+1+91+25+9(5)(1)+(−1)(−5)+(−3)(−3)=3519