What's the best guess for the parameter of an exponentially distributed sample?

119 Views Asked by At

I have a sample of size $N$ values. I know the values are exponentially distributed, i.e. they are distributed according to this probability density function:

$$ f(x;\lambda) = \begin{cases} \lambda e^{-\lambda x} & x \ge 0, \\ 0 & x < 0. \end{cases} $$

Is there a best guess for the parameter $\lambda$, given I know the the largest value in my sample and the size?

2

There are 2 best solutions below

0
On

The likelihood function for $\lambda$ is

$$L(\lambda) = \prod_{i=1}^n \lambda \exp(-\lambda x_i) = \lambda^n \exp \left(-\lambda \sum_{i=1}^n x_i\right)=\lambda^n\exp\left(-\lambda n \overline{x}\right),$$

where

$$\overline{x}={1 \over n}\sum_{i=1}^n x_i$$

is the sample mean.

The derivative of the likelihood function's logarithm is:

$$\frac{\mathrm{d}}{\mathrm{d}\lambda} \ln (L(\lambda)) = \frac{\mathrm{d}}{\mathrm{d}\lambda} \left( n \ln(\lambda) - \lambda n\overline{x} \right) = \frac{n}{\lambda}-n\overline{x}\ \begin{cases} > 0, \:\:\: 0 < \lambda < \frac{1}{\overline{x}}, \\[8pt] = 0, \:\:\: \lambda = \frac{1}{\overline{x}}, \\[8pt] < 0, \:\:\: \lambda > \frac{1}{\overline{x}}. \end{cases} $$

Consequently the maximum likelihood estimate for the rate parameter is:

$$\widehat{\lambda} = \frac{1}{\overline{x}}$$

0
On

Suppose you observe the sample maximum $x_n$ with sample size $n$, the corresponding likelihood function is

$$ L(\lambda) = (1 - e^{-\lambda x_n})^{n-1}\lambda e^{-\lambda x_n}$$

The log-likelihood is

$$ l(\lambda) = \ln L(\lambda) = (n - 1)\ln(1 - e^{-\lambda x_n}) + \ln\lambda - \lambda x_n$$

Differentiating with respect to $\lambda$, $$ \frac {\partial l(\lambda)} {\partial \lambda} = \frac {(n - 1)x_ne^{-\lambda x_n}} {1 - e^{-\lambda x_n}} + \frac {1} {\lambda} - x_n$$

You may need numerical method here to solve for the MLE.