How to prove that $H(X, Y) + H(Y, Z) \geq H(X,Z) + H(Y)$

411 Views Asked by At

If H is the entropy function (information theory), then what is a simple way to prove that

$H(X, Y) + H(Y, Z) \geq H(X,Z) + H(Y)$

for all random variables $X, Y, Z$?

1

There are 1 best solutions below

0
On BEST ANSWER

\begin{align*} H(X,Y) + H(Y,Z) &= \overbrace{H(Y) + H(X|Y)} + H(Y,Z) \\ &\geq H(Y) + \underbrace{H(X|Y,Z) + H(Y,Z)} \\ &= H(Y) + H(X,Y,Z) \\ &\geq H(Y) + H(X,Z) \end{align*}