This is a very elementary question, so please forgive me, but precisely because of this reason I haven't found an answer elsewhere:
How can it be proven that, among the integers, only $1$ and $-1$ have an integer multiplicative inverse? Or is that statement taken as an axiom?
This is readily proved once you properly define $\Bbb Z$ and its operations. We may want to start from $\Bbb N$ with its successor map $S$ and the Peano axioms, then define addition $\Bbb N\times \Bbb N\to\Bbb N$ recursively as $x+0:=x$, $x+Sy:=S(x+y)$, and then define multiplication recursively as $x\cdot 0=0$, $x\cdot Sy:=x\cdot y+y$.
Now we see that $(a,b)\sim (c,d):\iff a+d=b+c$ is an equivalence relation on $\Bbb N^2$, define $\Bbb Z:=\Bbb N^2/{\sim}$ as the set of equivalence classes, define $\overline{(a,b)}+\overline{(c,d)}:=\overline{(a+c,b+d)}$ and define $\overline{(a,b)}\cdot \overline{(c,d)}:=\overline{(a\cdot c+b\cdot d, a\cdot d+b\cdot c)}$ (which involves showing that this is well-defined). The claim now boils down to $\overline{(a,b)}\cdot\overline{(c,d)}=\overline{(1,0)}\implies a=Sb\lor b=Sa$. It does take a bit of work, but by going back the way we came can ultimately be reduced to a statement about $\Bbb N$ that is provable by induction.