I have no idea how to calulate entropy $H(X+S+Z,X+\alpha S)$ where $X\sim N(0,P)$, $S\sim N(0,Q)$, $Z\sim N(0,N)$ and $\alpha$ is a constant number.Here we use $N$ to denote Gaussian distribution. Can anyone hint me?
2026-03-25 06:03:52.1774418632
On
How to calulate entropy $H(X+S+Z,X+\alpha S)$
21 Views Asked by Bumbble Comm https://math.techqa.club/user/bumbble-comm/detail At
2
There are 2 best solutions below
0
On
Thank qeschaton who gives me the wikipedia link where I find the answer. I list the conclusion below. \begin{aligned}h\left(f\right)&=-\int _{-\infty }^{\infty }\int _{-\infty }^{\infty }\cdots \int _{-\infty }^{\infty }f(\mathbf {x} )\ln f(\mathbf {x} )\,d\mathbf {x} ,\\&={\frac {1}{2}}\ln \left(\left|2\pi e{\boldsymbol {\Sigma }}\right|\right)={\frac {k}{2}}\ln \left(2\pi e\right)+{\frac {1}{2}}\ln \left(\left|{\boldsymbol {\Sigma }}\right|\right)={\frac {k}{2}}+{\frac {k}{2}}\ln \left(2\pi \right)+{\frac {1}{2}}\ln \left(\left|{\boldsymbol {\Sigma }}\right|\right)\\\end{aligned}
Since $(X+S+Z, X+\alpha S)$ are jointly normal you can compute the entropy of a multivariate normal once you know its covariance matrix.