This is my first post so I hope it works! Taking the axioms for a group as an example, the literature defines a group in (at least) two different ways:
Method 1
A signature of $(G,\circ,\,^{-1})$ and axioms
- Associativity. $g_{1}\circ(g_{2}\circ g_{3})=(g_{1}\circ g_{2})\circ g_{3}$.
- Identity. $\exists e\in G,e\circ g=g$.
- Inverse. $g^{-1}\circ g=e$.
Method 2
A signature of $(G,\circ,\,^{-1},e)$ and axioms
- Associativity. $g_{1}\circ(g_{2}\circ g_{3})=(g_{1}\circ g_{2})\circ g_{3}$.
- Identity. $e\circ g=g$.
- Inverse. $g^{-1}\circ g=e$.
The difference between the two is the definition of the constant $e$.
So is there any mathematical difference between these methods. I presume that all theorems provable under method 1 are provable under method 2. Is that correct? If so, in general, is it the case that all constants can be excluded from signatures and introduced with an existential clause in an axiom?
For practical purposes, no.
$(G,\circ, ^{-1},e)$ is a definable extension of $(G,\circ, ^{-1})$. You can defined the identity in $(G,\circ, ^{-1})$ via $\varphi(x) \equiv (\forall y)(y \circ x = x \circ y = y)$ and so for almost all intents and purposes, these structures/languages are the same.
(In general, one difference between a language and it's definable extensions can be quantifier elimination. For instance, $Th(\mathbb{R}, +, \times, 0,1)$ does not have Q.E. but the definable expansion $Th(\mathbb{R}, +, \times, 0,1,<)$ does)