Let $SU(2)$ act on $V_2=\{ax^2+bxy+cy^2:a,b,c\in\mathbb C\}$ by $$\begin{pmatrix}a&b\\c&d\end{pmatrix}f(x,y)=f(ax+cy,bx+dy).$$ Then $SU(2)$ also acts on the $n$-th symmetric power $S^n V_2$. Show that $(S^n V_2)^{SU(2)}$ and $k_n[X,Y,Z]^{SO(3)}$ have the same dimension, where $k_n[X,Y,Z]$ is the space of degree n homogeneous polynomials.
Notations: $(S^n V_2)^{SU(2)}$ is the space of elements of $S^n V_2$ invariant under the action of $SU(2)$, $k_n[X,Y,Z]^{SO(3)}$ is the space of elements in $k_n[X,Y,Z]$ invariant under the action of $SO(3)$, which is given by $\begin{pmatrix}a&b&c\\d&e&f\\g&h&i\end{pmatrix}f(X,Y,Z)=f(aX+dY+gZ,...).$
My attempt: I know that $SU(2)/\{\pm I\}\cong SO(3)$. Also, $-I$ acts trivially on $V_2$, so $SO(3)$ acts on $V_2$. I guess I need to use this to show $k_n[X,Y,Z]^{SO(3)}$ is isomorphic to $(S^n V_2)^{SU(2)}$. However, I am not sure how to prove this. Can anyone help?
I will give a very rough sketch of how I think this can be proven.
To establish the isomorphism between invariants, we could try to establish the isomorphisms of the representations themselves.
As a first step, we need to use the correspondence between $n$-symmetric tensors and degree-$n$ homogeneous polynomials. We can define this correspondence by defining it between the separable tensors and monomials. Pick a basis for $V_2$, say $\{v_1, v_2, v_3\}$, then we can map a tensor of the form $\operatorname{Sym}(v_{i_1}\otimes \dots \otimes v_{i_n})$ to a monomial $X^a Y^b Z^c$, where $a, b, c$ count the number of times $v_1, v_2, v_3$ appears in the tensor, respectively. Through this correspondence, we can interpret $k_n[X, Y, Z]$ as the $n$-th symmetric power of the $3$-dimensional space of linear homogeneous polynomials in $X, Y, Z$, namely $k_1[X, Y, Z]$. It shouldn't be too hard to show that this correspondence is equivariant. It would probably follow from working through how the representation behaves on a symmetric power.
Next we may note that symmetric powers are functors, so we need only show that the representations $V_2$ (technically of $SU(2)/\{\pm I\}$) and $k_1[X,Y,Z]$ are isomrophic. Since these are just the three dimensional irreps of the two groups (or at least the right action versions), this is a standard result.
This proof idea sort of dodges the question of "what are the invariants". For $SO(3)$, this turns out not so hard to answer. Invariant polynomials of $SO(3)$ are all of the form $\phi(X^2+Y^2+Z^2)$ for some polynomial $\phi$, which means that $k_n[X,Y,Z]^{SO(3)} = \langle (X^2+Y^2+Z^2)^{n/2} \rangle$ when $n$ is even, and trivial otherwise. For $SU(2)$, describing symmetric polynomials are a bit trickier, but you can decompose $S^n V_2$ into irreps, and as it turns out, when $n$ is even you get exactly one invariant.