I have been thinking about this question for a while.
The Alternating group $A_5$ is isomorphic to the icosahedron group which has order 60. $A_5$ is a simple group which means the only normal subgroups are the trivial subgroup and itself.
The group defined by the external direct product $A_4 \oplus \mathbb{Z}_5$ is not simple but it does have order 60. Can we still define an Isomorphism from a simple group to a non simple group?
I might be over thinking this question but are all groups of order 60 isomorphic to each other?
Without solvability/simplicity, one can use the center. The center of $A_5$ is the trivial group $\{1\}$ while the center of $A_4\times C_5$ is at least $C_5$.