Give an explicit example of a pair of linear transformations $T : V \to W$ and $S : W \to U$ between vector spaces $V$, $W$, and $U$, so that neither $T$ nor $S$ is the zero linear transformation, but the composition $ST$ is the zero linear transformation.
Hint: What’s the relationship between the range of $T$ and the kernel of $S$?
I am struggling with this problem. Using the rank nullity theorem, I found that the range of $T$ as well as the the kernel of $S$ should have the same dimension as the domain of $T$. However, I'm confused as how to proceed from there. Any tips are appreciated!
Your conclusion from the rank-nullity theorem is inaccurate. It's quite alright for the range of $T$ to have smaller dimension than its domain (so long as it doesn't have dimension $0$), and it's quite alright for the kernel of $S$ to have larger dimension than the domain of $T$ (so long as it isn't all of the domain of $S$). We really need the range of $T$ to be a subspace of the kernel of $S$, though. If we don't have that, then there's some $y$ in the range of $T$ such that $Sy\neq 0$, but $y$ being in the range of $T$ means $y=Tx$ for some $x$ in the domain of $T$, whence $STx=Sy\neq 0$, and so our desired result fails.
In summary: Saying that $ST=0$ while $S,T\neq 0$ (where $T:V\to W$ and $S:W\to V$) is equivalent to the following conditions holding:
Coming up with an example shouldn't be too hard. Can you figure out two $2\times 2$ matrices $A,B$ such that $AB$ is the $2\times 2$ zero matrix, but neither of $A,B$ is a zero matrix?