Multiplying R1 by x , R2 by y and R3 by z and dividing the determinant by xyz , we get, xyz1∣∣x4+xxy3xz3x3yy4+yyz3x3zy3zz4+z∣∣=11 ⇒xyzxyz∣∣x3+1y3z3x3y3+1z3x3y3z3+1∣∣=11
Use R1→R1+R2+R3 (x3+y3+z3+1)∣∣1y3z31y3+1z31y3z3+1∣∣=11 ⇒x3+y3+z3=10 (as the value of the determinant is 1 )
Hence, all the possible solutions are (2,1,1),(1,2,1),(1,1,2)