The function given by the Rao-Blackwell theorem is a statistic

492 Views Asked by At

$(X_1,\ldots,X_n)$ is a random sample, $V_n$ is an unbiased estimator of the population parameter $\theta$ and $T_n$ is a sufficient statistic for $\theta$. Then by Rao-Blackwell theorem the rv

$$\varphi(T_n):=\mathbb E_\theta[V_n\mid T_n]$$

is an unbiased estimator of $\theta$ whic is uniformly better than $V_n$.

I know the definitions of conditional expectation and distribution, but I can't get how $\varphi(T_n)$ is an estimator (a function of the random sample that does't depend on $\theta$) using sufficiency

2

There are 2 best solutions below

3
On

For simplicity, consider the discrete case:

$$\mathbb E_\theta[V_n\mid T_n=t]=\sum_{\lbrace x:T_n(x)=t\rbrace}\mathbb P_\theta(X=x\mid T_n=t)V_n(x)$$

By sufficiency of $T_n$, $\mathbb P_\theta(X=x\mid T_n=t):=g(x,t)$ is independent of $\theta$. So,

$$\mathbb E_\theta[V_n\mid T_n=t]=\sum_{\lbrace x:T_n(x)=t\rbrace}g(x,t)V_n(x)$$

is independent of $\theta$ and is a statistic.

0
On

The definition of sufficiency is that the conditional distribution of all of the data given the value of the sufficient statistic does not depend on $\theta,$ i.e. it is the same for all distributions in the family.

If the conditional distribution does not depend on $\theta,$ then the conditional expectation does not depend on $\theta.$