Mutual information and chain rule

400 Views Asked by At

I'm having difficulty proving the below statement. It looks trivial but I don't know how to treat the term $XY$.

$I(XY ;Z) = I(X;Z)+ I(Y ;Z|X)$

How is it different form $I(X,Y ;Z) = I(X;Z)+ I(Y ;Z|X)$?

1

There are 1 best solutions below

1
On

You can write: \begin{align*} I(X,Y;Z)&=H(X,Y)-H(X,Y|Z)\\ &=H(X)+H(Y|X)-(H(X|Z)+H(Y|X,Z))\\ &=(H(X)-H(X|Z))+(H(Y|X)-H(Y|X,Z))\\ &=I(X;Z)-I(Y;Z|X) \end{align*}