By matrix-defined, I mean
$$\left<a,b,c\right>\times\left<d,e,f\right> = \left| \begin{array}{ccc} i & j & k\\ a & b & c\\ d & e & f \end{array} \right|$$
...instead of the definition of the product of the magnitudes multiplied by the sign of their angle, in the direction orthogonal)
If I try cross producting two vectors with no $k$ component, I get one with only $k$, which is expected. But why?
As has been pointed out, I am asking why the algebraic definition lines up with the geometric definition.
Assuming you know the definition of orthogonal as "a is orthogonal to b iff $a\cdot b=0$ then we could calculate $(a \times b)\cdot a = a_1(a_2b_3-a_3b_2)-a_2(a_1b_3-a_3b_1)-a_3(a_1b_2-a_2b_1)=0$ and $(a \times b)\cdot b-0$, so the cross product is orthogonal to both. As Nold mentioned, if the two vectors a and b lie in the x,y plane, then the orthogonal vectors must be purely in the z direction.