Show that $H \leq C_G(C_G(H))$.
We have that $C_G(H) = \left\{ g \in G | gh = hg \; \forall h \in H \right\}$. So then $C_G(C_G(H))$ is the $g$'s that commute with all $g$'s that commute with $h$. This would mean $$C_G(C_G(H)) = \left\{ g \in G | gg'h = hg'g, \; \forall g' \in G, \; \forall h \in H \right\}$$ But since $gg' \in G$ this is just some element of $G$, so doesn't this become the same as $C_G(H)$?
I feel like what I have is wrong but I am not sure why.
Pick $h\in H$. We wish to show that $hg=gh$ for any $g\in C_G(H)$. But this is tautological from the definition of $C_G(H)$, so $H\subset C_G(C_G(H))$.