In everyday math, if we ever prove the existence of a unique object with a certain property, we tend to give it a name and refer to it as "the" such-and-such object moving forward. For example, in ZFC set theory, an important early theorem is
$$\exists!x\forall y:y\notin x.$$
In words, "there is only one empty set." Thus we are (intuitively) justified in defining the constant $\varnothing$ to refer to the $x:\forall y:y\notin x.$
However, to my knowledge there is no rule in first-order logic that actually says you can do this. How is this procedure formally justified?
One idea I have is to treat newly defined constant symbols like $\varnothing$ as abbreviations that do not appear in the formal statements of the language. However, one couldn't simply use a rule: "replace every occurrence of $\varnothing$ with ... ," because the "..." would have to be a logical formula meaning "the unique $x$ such that $\forall y:y\notin x,$" which I don't think can be translated into first-order logic. It would have to be something a bit more complicated: For example, every proposition of the form $P(\varnothing)$ could translate to a formal version $\forall x\big((\forall y:y\notin x)\to P(x)\big)$. But now the proposition that we have written as $P(\varnothing)$ in our informal proof has become a formula with a seemingly very different structure in the formal proof (a formula that contains two extra quantifiers and an extra connective), so it isn't at all clear (to me) that the informal proof still translates into a formal proof in any straightforward way.
Look at Section 74 of Kleene's "Introduction to Metamathematics."
First-order logic does not address this, and, most people committed to first-order logic do not understand that this is the case. The reason first-order logic does not address this is that the development of a language in ordinary mathematics generates a sequence of signatures as definitions are made. By contrast, first-order logic hands you a signature and says, "Go."
It is true that explicit definitions for functions and constants will be eliminable from these signatures. But that is the nature of building a vocabulary. Skolem's primitive recursive arithmetic had been based upon his disagreement with Russell's theory of descriptions. His notion of the use of descriptions has never been represented formally because almost all description theory is motivated by Russell's treatment of descriptions as a form of quantifier. This is called "attributive use." Where controversy does exist, it involves "referential use" as presented by Strawson and probably assumed by Frege. What Skolem says about descriptions is different from both of these views.
As commonly applied, Tarski's semantic conception of truth treats constants like Russell had treated definite descriptions. And, Russell's declaration that definitions are mere abbreviations has influenced how these matters are commonly understood. In his book "Definition," Richard Robinson examines what Whitehead and Russell wrote about definition in "Principia Mathematica." It is terribly inconsistent.
If I recall correctly, the October 2015 thread on free logic at the FOM mailing list will have some debate on issues relevant to your question.
Caveat emptor.