Large deviation for gaussian distribution

1.8k Views Asked by At

Given a random variable $X$ that is $N(0,1)$ distributed and a sequence $(X_i)$ of iid distributed $N(0,1)$ random variables(copies of $X$) and I am supposed to calculate $P(X \ge 5)$ by means of large deviations.

Hence, I calculated the rate function $\gamma^*(l) = \frac{l^2}{2}$. And now I am stuck. Is the random variable $Z:=\frac{e^{-\gamma^*(5)} }{(2\pi)^{\frac{n}{2}}}e^{- \frac{X_1^2+...+X_n^2}{n}}$ now my estimator for this event, I am a little bit confused. Basically, I want to apply this theory here : wikipedia reference

If anything is unclear, please let me know.

2

There are 2 best solutions below

0
On BEST ANSWER

If $X$ is standard normal, then, when $x\to+\infty$, $$ P(X\geqslant x)\sim\frac{\mathrm e^{-x^2/2}}{x\sqrt{2\pi}}, $$ in the sense that the ratio of the LHS and the RHS converges to $1$. For $x=5$ this suggests that $P(X\geqslant5)$ might be close to $$ \frac{\mathrm e^{-12.5}}{5\sqrt{2\pi}}\approx2.97\cdot10^{-7}, $$ while the exact value is $$ P(X\geqslant5)\approx2.87\cdot10^{-7}. $$ Not an ounce of large deviations here. Large deviations in this context would yield the cruder estimate $$ P(X\geqslant x)=\exp\left(-\frac12x^2+o(x^2)\right), $$ or, equivalently, $$ \lim_{x\to+\infty}\frac{\log P(X\geqslant x)}{x^2}=-\frac12. $$

2
On

I think what you're after is

$$\Pr(\bar X > 5),$$

correct?

Note that for standard normal distributions the cumulant generating function is

$$\lambda(\theta) = \log E\bigl(\exp(\theta X_1)\bigr) = \log \Bigl[ \int_{-\infty}^\infty \exp(\theta x) \exp(-x^2/2) dx \big/ \sqrt{2\pi}\Bigr] = \theta^2/2.$$

So the Legendre-Fenchel transformation value is $I(5)=12.5$.

Hence

$$\Pr( \bar X >5) \approx \exp(-12.5n).$$

If that's not what you're after then please clarify.