Put M=2A−AT. Then A−2AT=−MT. For a 3×3 matrix, det(adjM)=(detM)2 and det(−MT)=−detM.
Therefore the given determinant equals (detM)4. Directly, M=10−α3012α12, so detM=−3α−1.
Hence (3α+1)4=28=44. Since α>0, 3α+1 is positive, so 3α+1=4 and α=1.
Expanding A gives detA=α−5=−4. Thus (detA)2=16, option (2).