I understand perfectly the argument making use of Cauchy's theorem, which I'll lay down for clarity's sake: take $p(x)$ of degree 5 irreducible over $\mathbb{Q}$. Let $K$ be the root field of $p(x)$ over $\mathbb{Q}$ and $G$ its galois group.
Take $r_1$ a root of $p(x)$, then $[\mathbb{Q}(r_1):\mathbb{Q}]=5$ and
$$ [K:\mathbb{Q}]=[K:\mathbb{Q}(r_1)][\mathbb{Q}(r_1):\mathbb{Q}]\Longrightarrow 5\mid [K:\mathbb{Q}] $$
Cauchy's theorem gives that $G$ has an element of order 5. Call $\sigma$ a 5-cycle permutation. Now, if $p(x)$ has 2 complex roots, $G$ has a transposition $\tau$. $G$ contains $\sigma\tau\sigma^{-1}$, $\sigma^{2}\tau\sigma^{-2}$, ..., $\sigma^{4}\tau\sigma^{-4}$, which are all possible transpositions and they generate $S_5$, hence $G=S_5$ and $p(x)$ is unsolvable by radicals because $S_5$ is an unsolvable group.
$\blacksquare$
This is clear and Cauchy's theorem is very elementary, but it puzzles me to imagine a 5-cycle that would always be a valid automorphism when there are 2 complex roots.
As an example of what I'm saying: take $\mathbb{Q}(\sqrt{2},\sqrt{3})$, then $\phi : \sqrt{2}\mapsto\sqrt{3}$ is not a valid automorphism
$$ 2 = \phi(2)=\phi(\sqrt{2}\sqrt{2})=\phi(\sqrt{2})\phi(\sqrt{2})=\sqrt{3}\sqrt{3}=3 $$
So the question is: how could I ensure that in such situations ($n$ is a prime and there's a pair of complex roots) the automorphisms are valid and couldn't end up in a case like above?
Now obsolete. The question was edited. That's fine, waiting for the issues to be isolated :-)
I'm not sure this exactly what you find puzzling, but it seems to me that it may fit. So, two observations:
Do observe that if $G$ is known to be abelian, then the complex conjugation $\phi$ will be in the center. If $\sigma$ is another element of $G$ and $r$ is a real root, then $\phi(r)=r$, and therefore also $$ \phi(\sigma(r))=(\phi\sigma)(r)=(\sigma\phi)(r)=\sigma(\phi(r))=\sigma(r) $$ implying that $\sigma(r)$ is real also. Note the role played by commutativity.