I read the following example in the book Counterexamples in Probability and Real Analysis by Gary L. Wise and Eric B. Hall:

Does anyone know simpler examples? I do have one! I would be glad to present it unless somebody gives an example more interesting than mine. (So this is a question to be eventually self answered.)
What about this: Let $N$ be geometric with success probability $1/2$ (so $Pr[N=k]=1/2^k$ for $k \in \{1, 2, 3, \ldots\}$). Take $X_1 =0$. For $1 \leq n < N$, independently define:
$$ X_{n+1} = \left\{ \begin{array}{ll} X_{n} + (|X_{n}|+8^{n+1}) &\mbox{ with prob $1/2$} \\ X_{n} - (|X_{n}|+8^{n+1}) & \mbox{ with prob $1/2$} \end{array} \right. $$
For $n> N$ define $X_n = X_N$. Then $|X_n|\geq 8^n$ whenever $1<n \leq N$ and so for $n>1$ we have $E[|X_n|] \geq 8^nPr[n\leq N] = \frac{8^n}{2^{n-1}}\rightarrow\infty$.