It says the inner product is defined by
$$\langle A,B\rangle = \mathrm{tr}(B^T A)$$
I know that if the cross product of $2$ vectors is $0$, than it means that the two basis are perpindicular, but how do I go about showing $4$ stardard basis matrices make up a perpendicular basis? The basis of this has $4$ different things.
Yeah, and it is 4-dimensional. So you have to show that $\| e_i \| = 1$ , $(e_i,e_j)=\delta_{ij}$ ($i=1,2,3,4$).
Where $e_1=\begin{bmatrix} 1 & 0 \\ 0 & 0 \end{bmatrix}$ and so on
So for example $(e_1, e_2) = \operatorname{tr}(e_1^t e_2) = \operatorname{tr}\begin{bmatrix}0 & 1 \\ 0 & 0\end{bmatrix} = 0$