I would like to verify the understanding of my claim.
In Model Theory: An Introduction by David Marker Example 1.2.5 defines the language of the theory of groups as follows to be $\mathcal{L}=\{., e\}$ where $.$ is a binary symbol and $e$ is a constant symbol called an identity element.
However, consider a reduced language $\mathcal{L_2}=\{.\}$. I claim that the identity element is definable, $\{e\}=\{e | e.e=e\}$ where $e.e=e$ is a defining formula.
Then we could just extend the theory of groups by the axiom:
$\exists e (e.e=e)$
Do we include a constant element in the language only for a convenience?
Yes. We only do it for the convenience.
Indeed one can write the axioms of the group in the following manner:
It's just easier to add this important constant to the language, rather than increasing the complexity of the formulas whenever we want to refer to that constant.
Note that we already do that with the $\cdot^{-1}$ operator, it's not in the language but it is definable. If one wants to simplify things even more, we can write the identity axiom in such way where $e$ is the unique such element.