There is a non-regular language that is recognized by a Turing Machine.
I believe the answer to this is true, because Turing machines can "count" computations and have a method to keep track of their previous operations.
A Turing Machine can have infinitely many states.
I believe this is true as well, but I'm not so certain why. I understand that the tape can be infinite, does this translate to an infinite number of states?
Yes, see the Chomsky hierarchy for more details.
It depends on what "states" mean:
That being said, without additional context meaning state$^1$ is much more probable than state$^2$.
I hope this helps $\ddot\smile$