Orthogonal complement of a set

26 Views Asked by At

Could someone help me woth finding the orthogonal complement to the set

\begin{bmatrix}1&1&0\\0&1&2\end{bmatrix}

\begin{bmatrix}3&0&1\\1&2&1\end{bmatrix}

(https://ctrlv.cz/T3IC here how it looks cause I can't put the matrixes next to eachother)

when the dot product is defined as $$(A,B)=Tr(A^TB)$$