I believe the following 2 facts are true...
1) Any group of prime order is a cyclic group
2) Any cyclic group of order n is isomorphic to $(\mathbb{Z}_n, +)$
So for example, every group of order $101$ is isomorphic to $\mathbb{Z}_{101}$, correct?
But what if the group order is not prime, for instance, is every group of order 24 isomorphic to $\mathbb{Z}_{24}$? Can this fail?
If you do not have a prime n, it does not have to be isomorphic to to $\mathbb{Z}_n$. For example, there are two groups of order 4. $\mathbb{Z}_4$ and $\mathbb{Z}_2\times\mathbb{Z}_2$. And $\mathbb{Z}_2\times\mathbb{Z}_2$ is not isomorphic to $\mathbb{Z}_4$, since $\mathbb{Z}_2\times\mathbb{Z}_2$ is not cyclic.
Yes, every group of order $p$ is cyclic. And every group of primeorder is isomorphic to $(\mathbb{Z}_p, +)$