Probability Distribution with certain Mutual Information Condition

36 Views Asked by At

I'm looking for an example of a probability distribution on X,Y,Z (any three r.v.'s) with $$I(X;Z) + I(Y;Z) < I(X,Y;Z)$$ where $I$ is standard mutual information. How might I go about this? Thanks!

1

There are 1 best solutions below

0
On

Taking $X,Y,Z$ to be pairwise independent but not mutually independent should work

For example, each of the following cases with probability $\frac14$:

X   Y   Z  
---------
0   0   0

0   1   1

1   0   1

1   1   0