We know
$$\int_{0}^{1}\Big(\frac{\operatorname{li}(x)}{x}\Big)^2dx= \frac{\pi^2}{6}$$
and
$$\int_0^1 4 \space\operatorname{li}(x)^3 \space (x-1) \space x^{-3} dx = \zeta(3) $$
see the proofs :
prove that $\int_{0}^{1}\Big(\frac{\operatorname{li}(x)}{x}\Big)^2dx= \frac{\pi^2}{6}$
Show that $\int_0^1 4 \space\operatorname{li}(x)^3 \space (x-1) \space x^{-3} dx = \zeta(3) $
But we also have this similar one :
$$ \int_1^{\infty} \frac{\operatorname{li}(x)^2 (x - 1)}{x^4} dx = \frac{5 \pi^2}{36} $$
That one is much harder to explain. Notice it is probably harder because the powers of $\operatorname{li}(x)^2$ and $x^4$ do not match and the integral is going from $1$ to $\infty$ !
How to prove this equality ?
A partial answer. We start from the Mellin transform $$\int_{1}^{+\infty}x^{s-1}\text{li}(x)dx=\frac{-\log\left(-s-1\right)}{s},\,\text{Re}(s)<-1.$$ Then, from Plancherel's theorem, we get $$\int_{1}^{+\infty}\frac{\text{li}(x)^{2}}{x^{3}}dx=\frac{1}{2\pi}\int_{\mathbb{R}}\frac{\left|\log\left(-it\right)\right|^{2}}{1+t^{2}}dt$$ where we are assuming that $\log(x)$ is the principal value $\text{Log}(z)$. Hence, the problem boils down to the evaluation of $$\frac{1}{\pi}\int_{0}^{+\infty}\frac{\log\left(t\right)^{2}}{1+t^{2}}dt=\frac{\pi^{2}}{8},$$ which can be easily deduced from the Mellin transform $$\int_{0}^{+\infty}\frac{t^{s}}{1+t^{2}}dt=\frac{\pi}{2}\sec\left(\frac{\pi s}{2}\right),\,\text{Re}(s)>-1$$ so $$\int_{1}^{+\infty}\frac{\text{li}(x)^{2}}{x^{3}}dx=\frac{\pi^{2}}{4}.$$ In a similar manner, we have $$\int_{1}^{+\infty}\frac{\text{li}(x)^{2}}{x^{4}}dx=\frac{1}{2\pi}\int_{\mathbb{R}}\frac{\left|\log\left(\frac{1}{2}-it\right)\right|^{2}}{\frac{9}{4}+t^{2}}dt$$ but this time the evaluation of the integral is less obvious. Still working on it.