There are formal definitions of various types of numbers; natural numbers, real numbers, ordinal numbers, cardinals etc. And we all regard them as some type of number.
The definition given in Wikipedia "A number is a mathematical object used to count, measure, and label". However this doesn't answer my question as it doesn't explain what common properties that counting, measuring and labelling have that makes them number like.
Are there properties that are universal across all things we call numbers that allow us to recognise them as being numbers and exclude non-numbers.
This is an extended comment rather than an answer.
Maybe it's noteworthy, first of all, that we are in a significantly different situation from some other cases in mathematics. For example, in algebra there is a very clear and common definition of what a "ring" is, and then there are Artinian rings, Noetherian rings, semisimple rings, commutative rings, primitive rings, reduced rings etc. etc., all with precise definitions which are specialisations of the general but well-defined mathematical concept of "ring".
Here it is different. Mathematicians have precise definitions for: natural numbers; complex numbers; $p$-adic numbers; ordinal numbers; real numbers; hyperreal numbers etc. However, many of these have sort of evolved independently historically, and it was very different people who gave them those names for various reasons. Unlike in the "ring" example, these are not special cases of some commonly agreed definition of "numbers". That concept, "number", is not really a mathematical one, but more of a common-language and/or philosophical one, whose name mathematicians have used for different concepts they investigate.
That being said, I do want to challenge the idea underlying the question and your comment (from Feb 25, 2016), that such a concept, like "number", is necessarily given by some common definition, i.e. all the things we call "number" have to have some clear thing in common.
Actually, this very notion has been famously discussed by Wittgenstein in his Philosophical Investigations, especially paragraphs 65--77, where instead he proposes the idea that some concepts are given by "family resemblance":
https://en.wikipedia.org/wiki/Family_resemblance
(This WP article seems to be a good first introduction, and it discusses similar ideas other philosophers have or have had, and (of course) also criticisms of the idea; but I really recommend reading at least the above paragraphs in Wittgenstein's original text. Then again, I recommend reading the entire Philosophical Investigations whenever I can.)
Actually, it turns out that "numbers" are the next example (after his famous introductory example "games") that Wittgenstein explicitly talks about:
-- loc. cit., §67