Gallian says in Chapter 3 of Contemporary Abstract Algebra that
For any element $a$ of a group $G$, it is useful to think of $\langle a \rangle$ as the smallest subgroup of $G$ containing $a$.
But wouldn't this mean the set $\langle a \rangle$ is simply $\{ a, a^{-1}, e \}$?
The set $\{a,a^{-1},e\}$ has an identity and is closed under inverses, but it isn't necessarily closed under the group's operation.
If $H$ is a subgroup and $a \in H$, you also need $a^2=aa\in H$ and $a^3=aaa \in H$ etc. Likewise, you need inverses for all of those elements (i.e. $a^{-1}, a^{-2}, \dots \in H$).
So closure under the group's operation and inverses require at least $\langle a \rangle = \{ a^n \;|\; n \in \mathbb{Z} \} \subseteq H$.
Once you know $\langle a \rangle$ is itself a subgroup. This shows that it is the smallest subgroup containing $a$.