Say I have to estimate an expectation of a function $X^{0.9}$ under exponential random measure(with density $f$), i.e., $$E_f(X^{0.9})= \int_0^ \infty x^{0.9} e^{-x} dx $$by importance sampling. The exponential tilted measure could be easily derived as $ f_{\theta }(x)={(1-\theta)e^{({1-\theta})x}} $. The optimal tilting parameter would be found by solute the equation
$$ \nabla E_{f_{ \theta }} [(X^{0.9}e^{-\theta X+ \psi (\theta)})^2] = \nabla E_f [X^{1.8}e^{-\theta X+ \psi (\theta)}]=0$$ where $\psi (\theta) = ln \Psi (\theta)$ is the cumulant function, and the moment generating function of X $\Psi (\theta) = \int f(x) e^{\theta x} dx = \int e^{-x} e^{\theta x} dx = \frac{1}{\theta-1}$. Therefore, $\theta^*$ is the root of the following nonlinear equation, $$\nabla \psi(\theta)= \frac{E_f [X^{1.8} X e^{-\theta X}]} {E_f [X^{1.8} e^{-\theta X}]} $$. However, we still need to evaluate two expectations which must be calculated via crude Monte Carlo method.In this case, I do not think importance sampling is superior to crude MC like $E_f(X^{0.9})= \int_0^ \infty x^{0.9} e^{-x} dx \sim \frac{1}{N} \sum_{n=1}^N X_n^{0.9} $ under directly sampling Exponential random variable X.
My questions are:
- Is my approach correct ?
It would be very kind if someone can comment on determination of optimal tilting parameter.
- Is this importance sampling for this integral better than crude MC method?
Thanks.
Is the goal to use importance sampling or to evaluate the integral? If the latter, I think numerical integration in R might work better:
Not surprising because $\int_0^\infty xe^{-x}\,dx = 1.$
Crude MC sampling (with error estimate):
Not sure what accuracy you need or what measure of efficiency you're using.