Perhaps, the class of ordinals $\Omega$ can be axiomatised up to isomorphism by claiming it to be well-ordered such that for every subset $X\subseteq \Omega$ there exists a "succesor" ordinal $\sigma$ which is the smallest ordinal larger than any element of $X$.
I dont like this axiomatization (and I am not even sure, if it works) because it already starts with the ordering. Compare that with Peano's Axioms which include only the successor function and allow to construct the ordering from it.
My question: Are there some axioms which characterize the class of ordinals "up to isomorphism" and do only rely on the "successor function" $$ \mathcal{P}(\Omega) \to \Omega \ ,\ X \mapsto \text{smallest ordinal larger than any element of}\ X $$ where $\Omega$ is the class of ordinals and $\mathcal{P}(\Omega)$ the class of all subsets. Problem: The successor function has to be axiomatized without referring to the ordering.
The idea is to think of ordinals not as the isomorphism classes of well-orderings but rather as a class that is inductively "generated" by the transfinitely iterated process of "counting the successor" of all numbers already being counted. This is the spirit of Peano's axioms, which also dont view the natural numbers as isomorphism classes of finite sets.
There seems to be a resemblance to the categorical idea of a "natural numbers object", which is a diagram $$ \{0\} \to \mathbb{N} \xrightarrow{n \to n+1} \mathbb{N} $$ being initial along all diagrams of the form $\{0\} \to X \to X$.
Maybe the class of ordinals can be described as a universal diagram of the form $$ \mathcal{P}(\Omega) \to \Omega \quad ?$$ Compare this to the fact, that for some set $X$, there is an embedding $X \to \Omega$ if and only if there is a choice function on its power set.
Edit: Here is an interesting property of the successor function which may be used for axioms: For any subset $T\subseteq \Omega$ we have $$ s(T) = s\left( \bigcup \lbrace R \in \mathcal{P}(\Omega) \mid s(R) = s(T) \rbrace \right) $$ and this construction allows for an ordinal $\sigma \in \Omega$ to implicitly use the set $\Omega_{<\sigma}$ of all smaller ordinals (which in the von Neumann model is equal to $\sigma$ itself).
Futher edit: Here is a sketch of the way I imagined ($s$ being the successor function):
- Formulate axioms allowing for a kind of recursion theorem involving commutative diagrams. Subidea: Any well-ordered class should give rise to a similar diagram, so the theorem that any well-ordered class can be embedded into $\Omega$ is a consequence of the universality of $\Omega$'s diagram.
- That recursion theorem should ensure that the recursive definition $$ \alpha + s(\emptyset) := \alpha, \qquad \alpha + s(B) := s( \lbrace \alpha + \beta \mid \beta \in B \rbrace )\qquad B \neq \emptyset $$ is well-defined.
- Define $$ \alpha \le \beta \qquad :\Leftrightarrow \qquad \exists \gamma : \alpha + \gamma = \beta $$ and finally prove this relation to be a well-ordering.
Will this work?

How about these axioms, with "s" and "is an ordinal" as undefined terms?
I've not included equality axioms because unlike the Peano axioms, these axioms require a larger theory of sets, and equality is part of that larger theory.
The ordinals do not form a set, since if $\Omega$ were the set of all ordinals, then by (1), $s(\Omega)$ is an ordinal, and so $s(\Omega) \in \Omega$, in contradiction to (2). Thus $\Omega$ can only be a class.
(4) implies that every ordinal is of the form $s(A)$ for some ordinal set $A$, since if $\alpha$ is an ordinal, then $\{\alpha\}$ is a set of ordinals. And by considering the set $\{s(A), s(B)\}$, it is easy to see that
If $\alpha = s(A)$ and $\beta = s(B)$, define $\alpha \le \beta$ if $s(A\cup B) = s(B)$. Two applications of (3) show that it is well-defined, and the bullet point shows that for all $\alpha,\beta$ we have $\alpha \le \alpha$, $\alpha \le \beta$ and $\beta \le \alpha \implies \alpha = \beta$ and either $\alpha \le \beta$ or $\beta \le \alpha$.
Transitivity is not much harder to prove: if $\alpha \le \beta$ and $\beta \le \gamma$, with $\alpha = s(A), \beta = s(B), \gamma = s(C)$, then $s(A\cup B) = \beta$, and $s(B\cup C) = \gamma$. Also since $\beta \le \gamma, \:s((A\cup B)\cup C) = \gamma$, but then $s(A \cup (B \cup C)) = \gamma$, which means $\alpha \le \gamma$.
Therefore $\le$ is a linear order on ordinals. (4) says that $\le$ is a well-order.