I recently stumbled upon this interesting definition of mathematics:
Math is the study of things that can be described as sets.
I am aware that the integers and the real numbers can be defined in terms of sets, but how can we define the operations of addition and subtraction?
You can use cardinals of sets to construct the natural numbers and prove the Peano axioms. Also you can use the ordinals defining $0:=\emptyset$ and $n^+:=n\cup \{n\}$, and so prove the Peano axioms again.
To construct the integers from natural numbers, you can use the cartesian product to define integers $(a,b)$ and $(c,d)$ such that two integers are equal if $a+d=c+b$.
The topic is technical so you need to read a book about set theory abd foundations. The Wikipedia has good references.