Posterior as Proportional to the Product of Likelihood and Prior

175 Views Asked by At

In many accounts of Bayesian inference the posterior is written as being proportional to the product of the likelihood and the prior:

$$ P(H \mid D) \propto P(D \mid H) P(H) $$

Why write it as a proportionality ? How does that impact actual estimation procedures? Why not work directly with Bayes' formula ?:

$$ P(H \mid D) = \frac{P(D \mid H) P(H)}{P(D)} $$

1

There are 1 best solutions below

0
On

In some situations, computing the denominator $P(D)$ can be computationally prohibitive, since it can be a sum (e.g. $P(D) = \sum_h P(D \mid H=h) P(H=h)$) or an integral (for continuous random variables).

If the information you need from the posterior probability doesn't require this normalizing constant (e.g. all you care about is how the posterior probabilities for different values of $H$ compare relative to each other), then you don't need to compute the normalizing factor $P(D)$ at all.