mean and variance formula derivation for multinomial distribution

2.6k Views Asked by At

I need a derivation of mean and variance formula for multinomial distribution. I tried to prove the formula, but I don't know what is meaning of expected value and variance in multinomial distribution. The formula for variance and mean is given as below in wikipedia: $ E({X}_{i})=n{p}_{i}\phantom{\rule{0ex}{0ex}} \;\; Variance({X}_{i})=n{p}_{i}(1-{p}_{i}) $ What do these equations indicate in definition of expected value?(in $E(X)=\sum _{x}^{}x\cdot p(x)$)

How can these equations be proved?

1

There are 1 best solutions below

8
On BEST ANSWER

they are the expectation and variance of the Outcome $i$ of the distribution. The single outcome is distributed as a Binomial $\text{Bin}(n;p_i)$ thus mean and variance are well known (and easy to prove)

Mean and variance of the multinomial are expressed by a vector and a matrix, respectively...in wikipedia link all is well explained IMHO

to prove these indicators simply observe that a binomial $S_n\sim \text{Bin}(n;p_i)$ is the sum of $n$ iid bernulli thus

$$\mathbb{E}(S_n)=\mathbb{E}\left(\sum_i X_i \right)=n\mathbb{E}(X_i)=np_i$$

$$\mathbb{V}(S_n)=\mathbb{V}\left(\sum_i X_i \right)=n\mathbb{V}(X_i)=np_i(1-p_i)$$


$$E(X)=\sum_{x=0}^{n}x\binom{n}{x}p^xq^{n-x}=\sum_{x=0}^{n}x\frac{n!}{x!(n-x)!}p^xq^{n-x}=$$

$$=np\sum_{x=1}^{n}\frac{(n-1)!}{(x-1)!(n-x)!}p^{x-1}q^{n-x}=$$

now set $y=x-1$and $m=n-1$ and you get

$$=np\underbrace{\sum_{y=0}^{m}\binom{m}{y}p^yq^{m-y}}_{=1}=np$$

to calculate the variance first similarly calculate $E(X^2)$ setting

$$x^2=x+x(x-1)$$