I see that all my understanding of statistics (& so of probability which is a branch of statistics) from high school came from the mathematics textbook and it all appears too mathematical to be accepted as a branch of mathematics but why then it isn't considered a branch of mathematics?
Edit 1
The first two answers I've got are contradicting each other one is claiming that it (statistic) falls under the domain of measure theory which is a branch of mathematics. So, it's entirely mathematical. The other one is saying that they are different.
Just sharing the story from my teacher.
He said that long ago, math and stats were different apart. Stats was just chart, mean, median, modus, standard deviation, and some other methods to simplify and generalize governmental numbers, and considered as a branch of governmental science.
After that, Blaise Pascal started the earliest Probability Theory, a branch of math. But still, math and stats were different.
However, people started to look for some arguments that would make statistical methods reasonable scientifically. And since math is the science about truth, reason, and logics (as long as we assume the postulates we need are true), and because drawing sample is actually a random experiment (in prob.theory point of view). Then, Mathematical Statistics born as the 'bridge' to connect stats and math (especially Probability Theory).
That is why, stats is not considered as a brach of math, but Mathematical Statistics is.
I don't know the validity of this story. This is just a sharing.