Find all orthogonal $3\times 3$ matrices of the form
\begin{bmatrix}a&b&0\\c&d&1\\e&f&0\end{bmatrix}
Using the fact that $A^TA$ = $I_n$, I set that all up and ended up with the following system of equations:
$$\left\{\begin{array}{l}a^2 + e^2 = 1\\ ab + ef = 0\\ b^2 + f^2 = 1\end{array}\right.$$
I know I can let things equal the sine and cosine of theta, but I'm not exactly sure how to write this answer down on paper. There has to be tons of possibilities, right? How many exactly?
There are few possibilities in fact. First of all, since $c^2+d^2+1^2=1$, $c=d=0$.
Now, you know that $a^2+b^2=1$, that $e^2+f^2=1$, and that $ab+ef=0$. This means that the matrix $\left(\begin{smallmatrix}a&b\\e&f\end{smallmatrix}\right)$ is orthogonal. Therefore, there is some $\theta\in\mathbb R$ such that$$\begin{pmatrix}a&b\\e&f\end{pmatrix}=\begin{pmatrix}\cos\theta&-\sin\theta\\\sin\theta&\cos\theta\end{pmatrix}\text{ or that }\begin{pmatrix}a&b\\e&f\end{pmatrix}=\begin{pmatrix}\cos\theta&\sin\theta\\\sin\theta&-\cos\theta\end{pmatrix}.$$