We are of course assuming $A$ is an $n\times n$ matrix.
I know there's a proof of it going the other way (invertibility implies a unique solution), but I'm trying to work out a proof going this way.
I'm looking for a proof that only uses the most basic concepts of linear algebra.
I know that:
1) Every matrix can be reduced to rref.
2) Elementary row operations do not change the solution set of $Ax = b$.
3) I also know that $Ix = y$, where $y$ is the particular solution.
I'm not sure how to prove that $[A|b]$ can be reduced to $[I|y]$, however, and that's where the problem lies.
Any help with this would be greatly appreciated.
if there's no solutions then you know $A$ is not invertible. on the other hand if there is at least one solution and if $A$ is not invertible then the set of vectors $x$ such that $Ax = 0$ is not trivial (contains some nonzero vector). do you see how to show that your solution to $Ax = b$ is not unique in this case?