I used integration by parts since we have two functions multiplied by each other.
$u=x^3$ $du=3x^2$ $dv=e^{-x^2}$ $v=-e^{-x^2}$
setting up got me:
$-x^3e^{-x^2}-\int -3x^2e^{-x^2}$ I then repeated the same steps over again and integrated by parts again
setting $u=-3x^2$ $du=-6x$ $v=e^{-x^2}$ $dv=-e^{-x^2}$
and obtained:
$-x^3e^{-x^2}--3x^2e^{-x^2}-\int -6xe^{-x^2}$
Doing so again gave me:
$-x^3e^{-x^2}+3x^2e^{-x^2}-6xe^{-x^2}-\int -6e^{-x^2}$
$-x^3e^{-x^2}+3x^2e^{-x^2}-6xe^{-x^2}+6e^{x^2}$
evaluating this final answer gives something that doesn't make sense, so I'm guessing that the approach to this problem was wrong but why? I was always under the impression that if you have two functions multiplied by each other then you integrate by parts, why on earth does that not work in this situation?
Write $u(x)=x^2$ and $v(x)=-{1\over 2}e^{-x^2}$, $\int u(x)v'(x)dx=\int x^3e^{-x^2}dx= uv]-\int -xe^{-x^2}dx$ $=uv]_0^{\infty}-{1\over 2}e^{-x^2}]_0^{\infty}={1\over 2}.$