What's the correct terminology to say "We can calculate the probability exactly using pure math, as opposed to Monte Carlo simulation"?
- Analytically sounds like we need Calculus, which we may not
- Combinatorically sounds like we can only use combinatorics
- exactly sounds like a precision issue and misses the point
- and closed form is no good, because quite often the exact solution is not in closed form - it's expressed as a recurrence or the like
The point is that we solve the probability formally, not needing to rely on simulation - what is the correct term?
I think your interpretation of Analytically is a bit narrow. An analytical solution is as opposed to a numerical solution, regardless of whether you use calculus. I'm sure you've checked this page and this, which highlights a key feature of a purported analytic solution: You can express the exact answer using elementary functions and operations. Anything else is not an analytic solution, for example:
Just because you can write out the solution formally does not mean it is analytic. For example: $y(x)=\int ix\Gamma(x^{{x^2}}) dx + C$ is a solution to $y'=ix\Gamma(x^{{x^2}})$, but it certainly is not an analytical solution, as you need to approximate the solution numerically. A grey area is infinite series solutions, which are exact and expressed using simple operations and functions, yet getting an exact numerical answer is impossible, since you have to truncate. However, this falls under analytic as well.