From being away from mathematicians for a while and spending most of my time with econometricians and statisticians, one thing I've noticed is that econometricians and statisticians like to use $\prime$ to denote the matrix transpose, e.g., $X^{\prime}$.
However, when you show this notation to a mathematician, they'd think that you mean a matrix distinct from $X$; i.e., $X$ and $X^{\prime}$ are just two distinct matrices with no explicit relation. Hence when I'm on MSE, I always try to use $X^{T}$ instead.
My guess is that the $X^{T}$ notation has been around longer than $X^{\prime}$. Who was the first to use $X^{\prime}$ to denote the matrix transpose?
In A History of Mathematical Notations (vol. 2) by Florian Cajori (1929) on p. 103, the use of $A^{\prime}$ to denote the "conjugate" of a matrix $A$ (what we now usually call the "transpose") is credited to
This notation is defined in p. 5 of that text. From kimchi lover's answer, it appears that $A^{\prime}$ predates $A^{T}$.