List questions from information-theory

Published on 31 Mar 2026 - 0:16

2.7k

Views

Convexity of KL-Divergence

Published on 30 Sep 2017 - 21:23

272

Views

Given a Markov chain $X \rightarrow Y \rightarrow Z$, under what condition $I(X;Y) = I(X;Z)$

Published on 02 Oct 2017 - 2:13

41

Views

Consider two distributions $P(·)$ and $Q(·)$ on the alphabet ...

Published on 03 Oct 2017 - 20:51

847

Views

Grouping Property in Entropy

Published on 30 Mar 2026 - 20:39

55

Views

Information theoretic measures

Published on 05 Apr 2026 - 18:19

172

Views

Show that typical sets satisfy $|A_\epsilon^{(n)}(p)|>|A_\epsilon^{(n)}(q)|$ if $0.5\ge p>q$

Published on 03 Apr 2026 - 13:32

222

Views

Jaynes probability Exercise 3.3 (maximum-entropy)

Published on 30 Mar 2026 - 20:36

99

Views

Conditional entropy for Conditional random variables

Published on 10 Oct 2017 - 16:36

539

Views

Mutual information - Joint distribution of unfair coin flips

Published on 11 Oct 2017 - 20:25

908

Views

Does Huffman coding with increasing word length approach the Shannon information limit?

Published on 14 Oct 2017 - 5:53

319

Views

Non Gaussian Additive Channel Capacity

Published on 17 Oct 2017 - 15:04

141

Views

"Conditioned" mutual information

Published on 17 Oct 2017 - 15:28

31

Views

Bounds on non-Gaussian channels with additive noise

Published on 18 Oct 2017 - 14:56

38

Views

Mutual Information for Jointly Distributed r.v.'s

Published on 18 Oct 2017 - 16:09

List Question

What are spherically symmetric function?

Convexity of KL-Divergence

Given a Markov chain $X \rightarrow Y \rightarrow Z$, under what condition $I(X;Y) = I(X;Z)$

Consider two distributions $P(·)$ and $Q(·)$ on the alphabet ...

Grouping Property in Entropy

Information theoretic measures

Show that typical sets satisfy $|A_\epsilon^{(n)}(p)|>|A_\epsilon^{(n)}(q)|$ if $0.5\ge p>q$

Jaynes probability Exercise 3.3 (maximum-entropy)

Conditional entropy for Conditional random variables

Mutual information - Joint distribution of unfair coin flips

Does Huffman coding with increasing word length approach the Shannon information limit?

Non Gaussian Additive Channel Capacity

"Conditioned" mutual information

Bounds on non-Gaussian channels with additive noise

Mutual Information for Jointly Distributed r.v.'s

Trending Questions

Popular # Hahtags

Popular Questions