What does this notation mean for Expectation and Variance?

580 Views Asked by At

Let $f: \{-1,1\}^n \rightarrow \mathbb{R}$

Then the influence function of $x_i$ is defined by $$ \text{Inf}_i(f) = \mathbb{E}_{(x_1,...,x_{i-1},x_{i+1},...,x_n)}[\text{Var}_{x_i}[f]]$$

What does the subscript on the expectation mean? And what does the subscript on the Var mean? The probability space in question is the uniform distrubtion on $\{-1, 1\}^n$

1

There are 1 best solutions below

3
On BEST ANSWER

Assume that the product space $\Omega=X\times Y$ is endowed with the product probability $P=\mu\otimes\nu$ for some probability $\mu$ on $X$ and some probability $\nu$ on $Y$. For every (integrable) random variable $Z$ on $\Omega$, $E_x(Z)$ is the random variable $T$ on $Y$ defined, for every $y$ in $Y$, by $$T(y)=\int_XZ(x,y)\mathrm d\mu(x),$$ and $$E_y(T)=\int_YT(y)\mathrm d\nu(y).$$ Likewise, $\mathrm{Var}_x(Z)=E_x(Z^2)-(E_x(Z))^2$, where $E_x(Z^2)$ is the random variable $S$ on $Y$ defined, for every $y$ in $Y$, by $$S(y)=\int_XZ(x,y)^2\mathrm d\mu(x),$$ and $$E_y(S)=\int_YS(y)\mathrm d\nu(y).$$ Note that, in general, $$E_y(\mathrm{Var}_x(Z))\ne\mathrm{Var}(Z),$$ since $$E_y(\mathrm{Var}_x(Z))=\int_\Omega Z^2\mathrm dP-\int_Y\left(\int_XZ(x,y)\mathrm d\mu(x)\right)^2\mathrm d\nu(y),$$ while $$\mathrm{Var}(Z)=\int_\Omega Z^2\mathrm dP-\left(\int_\Omega Z\mathrm dP\right)^2=\int_\Omega Z^2\mathrm dP-\left(\int_Y\int_XZ(x,y)\mathrm d\mu(x)\mathrm d\nu(y)\right)^2.$$ This shows the general inequality $$E_y(\mathrm{Var}_x(Z))\leqslant\mathrm{Var}(Z).$$