How many simulations for a game?

157 Views Asked by At

Lately I was interested by Monte-Carlo simulations. I found many papers about this approach in the Internet but for now they are too hard for me. I just want to start understanding this method with something easier.

For this reason I started to wonder how is it efficient in particular cases. So lets say that I have a game, for two players, with $n$ (very, very big) possible, equally likely, starting points. From each starting point I am able to simulate this game. We can also assume, for now, that from each starting point there is single path to the end of this game.

Now, lets distinguish particular end state of this game (could be draw or something). How many random simulations do I have to perform to know the probability of this state, when playing from random starting point, up to $2$ or $3$ or $4$ and so on, decimal places? Is it very hard to estimate? Maybe you know where I can search to satisfy my curiosity in this topic?

1

There are 1 best solutions below

4
On BEST ANSWER

What you're talking about is a direct sampling approach, where you can randomly choose your start point from across the whole sample space of start points. Results are independent and uncorrelated and in general your standard error is going to be inversely proportional to the square root of the number of trials in your simulation. (I.e., here you're really solving the classical statistical problem of estimating a population parameter by taking iid draws from the population.)

But Monte Carlo methods also encompass situations where you can't directly sample, and you have to explore the sample space "step by step". In this case the Metropolis algorithm and its close cousin the Metropolis Hastings algorithm is a very popular approach. Here, results that are close together tend to be correlated, and so estimating the standard error, and convergence, is harder (naive approaches underestimate the error). Nevertheless there are various heuristics / methods for doing so, including repeatedly taking the average of adjacent results until the estimate of the standard error stabilises, as well as graphical methods.

If you are really interested in this topic, I would highly recommend the coursera Statistical Mechanics: Algorithms and Computations course. This is an extremely well-presented course that covers Monte Carlo simulation in the context of statistical mechanics. It has active input from course members on the discussion forums, and uses simple Python programs to explore simulation in a practical way. Although you have missed the first assignment (and likely the second one too), the first couple of weeks' videos are a very good introduction to Monte Carlo simulation, the different kinds of sampling approaches, and how to estimate errors.