Background: ZFC in classical first-order logic.
To make a definition, we first need to proof something does exist. So, this question is actually about proving something exists based on a recursion.
I know that when you want to prove the existence of a certain function with the domain of ordinal numbers, you can use the transfinite recursion theorem. But our things are not always a function of this sort. For example, when we define the truth value function on the set of formulas in predicate logic, we usually define it recursively based on the number of the logical symbols in a formula(or complexity). But for a certain complexity of the formulae, there're many cases to deal with. I can't figure out how to prove such a definition does make sense, aka the function does exist.
The fact that a recursive definition produces a value for every natural number appearing as the index is a consequence of the induction axiom, which is part of Peano Arithmetic (PA). This is not quite enough to get the existence of the function as a single object. The latter follows from the axiom of separation of Zermelo-Fraenkel set theory (ZF). Thus, PA gives you the value at any $n$, and ZF guarantees the existence of the function as a single entity (no "C" is needed).