Derive a formula for the least squares solution with two column vectors

26 Views Asked by At

I am new to this least square solution. If a and b are column vectors in $\Bbb R^N$, then wouldn't the least square solution of a$x$=b be $A^TAx = A^Tb$?

I am really having a hard to visualizing this.