I find the following text on the Wikipedia page on first order logic:
First-order logic is the standard for the formalization of mathematics into axioms and is studied in the foundations of mathematics. Peano arithmetic and Zermelo–Fraenkel set theory are axiomatizations of number theory and set theory, respectively, into first-order logic. No first-order theory, however, has the strength to uniquely describe a structure with an infinite domain, such as the natural numbers or the real line. Axioms systems that do fully describe these two structures (that is, categorical axiom systems) can be obtained in stronger logics such as second-order logic.
Here, what I want to ask is what does uniquely describe/characterize mean? Why is it that $\textbf{FOL}$ cannot uniquely describe/characterize $\mathbb{R}$ or $\mathbb{N}$?
Here's the precise statement: if $\Phi$ is any set of first order sentences true in $\mathcal{N}=(\mathbb{N}; +, \times)$, then there is a structure $\mathcal{A}$ such that
The sentences in $\Phi$ are also true in $\mathcal{A}$, and
$\mathcal{A}\not\cong\mathcal{N}$.
That is, no set of first-order sentences characterizes $\mathcal{N}$ up to isomorphism. The same is true for any other infinite structure.
This is a consequence of the compactness theorem for first-order logic; but you may also be interested in the Lowenheim-Skolem theorem, which describes another fundamental obstacle to describing structures in first-order logic.
Belatedly incorporating and expanding on an observation by Vladimir Kanovei, if we're a bit flexible about our requirements and push a little into the second-order realm we can find a lot of positive results:
$\mathcal{N}=(\mathbb{N}; +,\times)$ is characterizable up to isomorphism as the minimal model of a particular first-order theory.
By the downward Lowenheim-Skolem theorem no minimality characterization is possible for the field $\mathcal{R}=(\mathbb{R};+,\times)$, and compactness (in its guise as the upward Lowenheim-Skolem theorem) prevents any maximality characterization for any infinite structure whatsoever. However, $\mathcal{R}$ is characterizable as the maximal model of the first-order theory of real closed fields which additionally omits the partial type describing an infinite element (= is Archimedean).
Somewhat less naturally, $\mathcal{R}^-=(\mathbb{R};+,<)$ is the minimal model of the first-order theory of divisible ordered abelian groups which realizes every type over a countable set of parameters which is bounded above and has ordertype $\omega$.
It's worth noting that $(i)$ pretty much every naturally-occurring structure can be described up to isomorphism by a second-order theory or even sentence (Vaananen: "the ordered structure of the natural numbers, the complete separable Archimedian field of reals numbers, the complex field, as well as practically all commonly occurring mathematical structures have a categorical second order axiomatisation"), and $(ii)$ we usually only need a small fragment of $\mathsf{SOL}$ to do this.