Finding posterior mean, median and mode

1.5k Views Asked by At

Consider the probability, $\theta$, that a randomly selected person in NYC is from Manhattan. We collect data as we walk down Times Square. We ask three people whether they are from Manhattan, and all three respond with yes.

Assuming a flat prior for $\theta$,

a) Find the posterior distribution of $\theta$, conditional on observed data. Also find the mean and mode of $\theta$, while also deriving an expression for median of $\theta$ as well.

b) Find the predictive distribution that a randomly selected fourth person is also from Manhattan.

By flat prior does it mean that in this case, since it's a yes or no question, I am to assume that the probability of a yes on any given answer is 0.5? And if this is the case, how would the normal situation, where we have posterior $\propto$ likelihood $\times$ prior apply in this case?

Would really appreciate detailed help for the other parts as well. Thanks in advance!

1

There are 1 best solutions below

4
On BEST ANSWER

I doubt that sampling in Times Square will give unbiased information about New York City as a whole, but ignoring that:

  • A flat prior is one with a constant density, here on the interval $[0,1]$, so your prior is $\pi_0(\theta)=1$ for $0 \le \theta \le 1$

  • The likelihood here is proportional to the conditional probability that all three would say yes, which is $\theta^3$

  • So the posterior distribution is proportional to the product of these, i.e. also proportional to $\theta^3$ in $[0,1]$

I will leave it to you to find the constant of proportionality, mean, mode, median etc.