This integral
$$\int_0^1\frac{\arctan(x^2)}{1+x^2}\,\mathrm dx$$
appears very similar to $\int\frac{\arctan x}{1+x^2}\,\mathrm dx$. But, this question cannot be solved through the same simple substitution of $u=\arctan x$. WolframAlpha cannot find a symbolic solution to this problem, and this Quora answer is the only thing I can find that appears to have the exact answer of $\frac14\log^2(1+\sqrt2)$.
I am not sure if there is some special trick to be used in solving this, but I have tried everything I know and nothing seems to work.
$\begin{align} \displaystyle\int_0^1 \dfrac{\arctan(x^2)}{1+x^2}dx&=\Big[\arctan x\arctan(x^2)\Big]_0^1-\int_0^1 \dfrac{2x\arctan x}{1+x^4}dx\\ &=\dfrac{\pi^2}{16}-\int_0^1 \dfrac{2x\arctan x}{1+x^4}dx\\ \end{align}$
Since,
$\displaystyle \arctan x=\int_0^1 \dfrac{x}{1+t^2x^2}dt$
then,
$\begin{align} \displaystyle K&=\int_0^1 \dfrac{2x\arctan x}{1+x^4}dx\\ \displaystyle &=\int_0^1\int_0^1 \dfrac{2x^2}{(1+t^2x^2)(1+x^4)}dtdx\\ \displaystyle &=\int_0^1\int_0^1 \left(\dfrac{2t^2}{(1+t^4)(1+x^4)}+\dfrac{2x^2}{(1+x^4)(1+t^4)}-\dfrac{2t^2}{(1+t^4)(1+t^2x^2}\right)dtdx\\ &=\displaystyle 4\left(\int_0^1 \dfrac{t^2}{1+t^4}dt\right)\left(\int_0^1 \dfrac{1}{1+x^4}dx\right)-K \end{align}$
Therefore,
$\displaystyle K=2\left(\int_0^1 \dfrac{x^2}{1+x^4}dx\right)\left(\int_0^1 \dfrac{1}{1+x^4}dx\right)$
Since,
$\begin{align}\displaystyle \int_0^1 \dfrac{x^2}{1+x^4}dx&=\left[\dfrac{1}{4\sqrt{2}}\ln\left(\dfrac{x^2-\sqrt{2}x+1}{x^2+\sqrt{2}x+1}\right)+\dfrac{1}{2\sqrt{2}}\arctan\left(\sqrt{2}x+1\right)+\dfrac{1}{2\sqrt{2}}\arctan\left(\sqrt{2}x-1\right)\right]_0^1\\ &=\dfrac{1}{4\sqrt{2}}\Big(\pi+\ln\left(3-2\sqrt{2}\right)\Big) \end{align}$
and,
$\begin{align}\displaystyle \int_0^1 \dfrac{1}{1+x^4}dx&=\left[\dfrac{1}{4\sqrt{2}}\ln\left(\dfrac{x^2+\sqrt{2}x+1}{x^2-\sqrt{2}x+1}\right)+\dfrac{1}{2\sqrt{2}}\arctan\left(\sqrt{2}x+1\right)+\dfrac{1}{2\sqrt{2}}\arctan\left(\sqrt{2}x-1\right)\right]_0^1\\ &=\dfrac{1}{4\sqrt{2}}\Big(\pi-\ln\left(3-2\sqrt{2}\right)\Big) \end{align}$
Therefore,
$\boxed{K=\displaystyle \dfrac{\pi^2}{16}-\dfrac{1}{16}\Big(\ln\left(3-2\sqrt{2}\right)\Big)^2}$
Therefore,
$\boxed{\displaystyle\int_0^1 \dfrac{\arctan(x^2)}{1+x^2}dx=\dfrac{1}{16}\Big(\ln\left(3-2\sqrt{2}\right)\Big)^2}$
NB:
$\displaystyle \left(3-2\sqrt{2}\right)=\left(1-\sqrt{2}\right)^2=\frac{1}{\left(1+\sqrt{2}\right)^2}$
therefore,
$\displaystyle \ln^2\left(3-2\sqrt{2}\right)=4\ln^2\left(1+\sqrt{2}\right)$