For 0≤x≤1, tan−1(x+1)− tan−1x lies in (0, 2π), and its tangent is [1+x(x+1)]1. Consequently cot−1(1+x+x2)=tan−1(x +1)− tan−1x, with no branch adjustment.
The integral becomes ∫12 tan−1udu− ∫01 tan−1u du. Integration by parts gives the antiderivative F(u)=utan−1u−(21)ln(1 +u2).
The value is F(2)−2F(1)+F(0)=2tan−12 −(21)ln5− π/2+ln2= 2tan−12−(21)ln(45)− 2π,
option 4.