This is something I've wondered about for a while now; What is so special about normal subgroups that makes modding out by them "act nice"?
I understand the proofs for things like the first isomorphism theorem, but all these proofs really seem to do is verify that we can mod out by any sub-group satisfying $gNg^{-1} = N$ and end up with another group. I get the verification; that's not what I'm asking about.
It's possible to mod out by any subgroup, but what's so special about the property $gNg^{-1} = N$ that makes it so that we can "move" $N$ around inside $G$ in a way that satisfies the group axioms? Is there something deeper about the normality property that makes this make sense?
Concerning your comment about "the group consisting of ways to move N inside of G", the group structure is actually being given to a way of moving the cosets of $N$ around rather than $N$ itself.
A standard way of moving subgroups themselves around is by conjugation:- $H$ going to $g^{-1}Hg$.
Here one can see something very special about normal subgroups. They are precisely the subgroups which do not move around at all!
Furthermore this is the property used in standard proofs that the group operation on cosets is well defined.