The best I could come up with :
$G$ consists of :
The identity $e$,
Generators of $G$,
Generators of the subgroup (say, $H$) which is of order $p$.
If order of $G$ is $n$, then there are $φ(n)$ generators of $G$. Since $H$ is a proper subgroup, all the $p-1$ generators of $H$ are different from those of $G$. And then there's $e$. So order of $G$ is $φ(n)+p$.
So, $n=p^2$. Otherwise you can obtain more than one subgroup.
We know that subgroups of $\Bbb Z$ has the form $n\Bbb Z=\{na| n\in \Bbb N, a\in \Bbb Z \}$. If it has prime order subgroup we can find $n\in \Bbb N$ such that $pn=1$. This is a contradiction. Actually, we know that any subgroup of $(\Bbb Z, +)$ is infinite.