It seems natural that it should converge, because for any $A\in\mathbb{R}$, $$\int_{-A}^A x\,\mathrm{d}x=\int_{-A}^0 x\,\mathrm{d}x+\int_0^A x\,\mathrm{d}x=\left[\frac{x^2}{2}\right]_{-A}^0+\left[\frac{x^2}{2}\right]_0^A=-\frac{(-A)^2}{2}+\frac{A^2}{2}=0.$$
So the integral is zero for every such value $A$, yet it doesn't converge, according to wolfram alpha. How come?
All that is true, but the definition of convergence of integrals of this type is
Since neither $\int_0^\infty x\,dx$ or $\int_{-\infty}^0x\,dx$ converge, the two-sided improper integral does not converge.