Suppose we are talking about non-principal square roots and we know that $\sqrt{4} = 2$, and also $\sqrt{4} = -2$. I am wondering how this works in the imaginary domain? Does the square root of a negative number also have two solutions? $\sqrt{-4} = 2i$ and $\sqrt{-4} = -2i$. Is this possible?
I have seen this here in the first answer, but it does not make sense to me.
Yes, that's how it happens (except for $0$, which has only one square root: $0$). If $a,b\in\mathbb R$ and $b\neq 0$, then both numbers$$\pm\left(\sqrt{\frac{a+\sqrt{a^2+b^2}}2}+\frac{\lvert b\rvert}b\sqrt{\frac{-a+\sqrt{a^2+b^2}}2}\,i\right)$$are square roots pf $a+bi$.