What exactly are we supposed to do to show what they have given is a martingale.
If I try to follow through I'm getting a bit confused. In the third to last line I don't understand how they have simplified the first two terms to get $0$ and $t-s$ respectively.

A martingale $(M_t)_{t\geq 0}$ is an $\mathcal{F}_t$-adapted stochastic process that satisfies $\mathbb{E}(M_t\mid \mathcal{F}_s) = M_s$ for all $s,t$ with $0\leq s \leq t$. Intuitively, this means that a Martingale does not on average change over time (with respect to a particular probability measure; in this case the one corresponding to $\mathbb{E}$).
Note that we can write the equation mentioned above as $\mathbb{E}(M_t - M_s \mid \mathcal{F_s})=0$, which is exactly what you have in your question.
The third-last line uses the facts that $\mathbb{E}(W_t - W_s\mid\mathcal{F}_s)=0$ (a Wiener process is a Martingale) and $\mathbb{E}((W_t - W_s)^2\mid\mathcal{F}_s)=t-s$ (a Wiener process accrues variance at rate one per unit time). These properties are detailed here.