Computing expectation of MLE?

61 Views Asked by At

This is a part of lecture note. Reviewing it I am not clear with the process. How can I expand $\operatorname{E}\left[\dfrac 1 {\left(\sum X_i\right)}\right]$ to make it $\displaystyle\int {(\lambda^n)(x^{n-1}) \exp(-\lambda x)\,dx \over x(n+1)!}$? It's usung MLE of Gamma distribution for $X_i$'s from exponential distribution.

1

There are 1 best solutions below

5
On BEST ANSWER

Let $X_1,\dots,X_n$ be a random sample from Exponential rate $\lambda$ distribution.

Note that $\sum_{i=1}^n X_i \sim \Gamma(n,\lambda$). You can see this with moment generating functions.

So let $Z \sim \Gamma(n,\lambda)$. \begin{align*} E\left[1/\sum_{i=1}^n X_i \right] = E[1/Z] &= \int_0^\infty \dfrac{1}{z} \dfrac{\lambda^n}{\Gamma(n)} z^{n-1} e^{- \lambda z} \; dz \\ &= \int_0^\infty \dfrac{\lambda^n}{\Gamma(n)} z^{n-2} e^{-\lambda z } \; dz \\ &= \lambda \dfrac{\Gamma(n-1)}{\Gamma(n)} \underbrace{\int_0^\infty \dfrac{\lambda^{n-1}}{\Gamma(n-1)} z^{n-2} e^{-\lambda z } \; dz}_{=1} \\ &= \dfrac{ \lambda \Gamma(n-1)}{\Gamma(n)} = \dfrac{ \lambda}{n-1} \end{align*}