I'm trying to show that $\mathbb{E}[|X_t - X_s|^2] = |t - s|$ but the absolute value is confusing me.
I know that $X_t - X_s \sim\mathcal{N}(0,t-s)$
so $\mathbb{E}[(X_t - X_s)^2] - \mathbb{E}[X_t - X_s]^2 = t-s $
but how do I bring the absolute value in?
You statements only hold true if $t \ge s$. If $t < s$, you cannot end up with a negative on the RHS since the LHS is all positive.
So then you rename $X_t$ to $X_s$ and vice versa, ending up in $s-t$, but if you want one expression for all cases, it is always $|t-s| = |s-t|$, just a convenient notation not to write the branches out.