Why accept worse samples in Metropolis–Hastings Algorithm?

83 Views Asked by At

In the Metropolis–Hastings algorithm you accept a new sample based on how probable the new proposed sample is with respect to the current sample. But what is wrong with only accepting when the new proposed sample is actually better?

1

There are 1 best solutions below

0
On BEST ANSWER

You want to satisfy detailed balance for the Markov chain you're creating in MH, so that you automatically have the right stationary distribution.

Calculate out the stationary distribution if you do as you propose for some small example, and see what happens; you will get a different distribution.