List questions from entropy

Published on 23 Nov 2016 - 18:20

416

Views

Binary symmetric channel: Why is $\sum p(x) H(Y \mid X = x) = \sum p(x) H(p)$?

Published on 24 Nov 2016 - 12:50

16.3k

Views

Entropy of the multivariate Gaussian

Published on 26 Mar 2026 - 21:12

554

Views

Entropy function inequality

Published on 26 Nov 2016 - 20:37

121

Views

Interpreting a (function of) probability distribution as a random variable?

Published on 04 Dec 2016 - 4:54

720

Views

Fano's Inequality

Published on 07 Dec 2016 - 15:08

216

Views

Shannon's proof of entropy power inequality

Published on 08 Dec 2016 - 23:05

1.1k

Views

Shannon Entropy

Published on 15 Dec 2016 - 18:41

1.6k

Views

What does a `reference measure' mean in the context of defining Shannon entropy?

Published on 16 Dec 2016 - 22:45

82

Views

$I[X,Y] :=- \sum_{x,y} p(x,y)\ln{p(x,y)}$, Show that $I[X, Y] \le I[X]+I[Y]$

Published on 17 Dec 2016 - 9:18

40

Views

Is the topological entropy time-reversal invariant?

Published on 18 Dec 2016 - 13:41

3.1k

Views

How do I maximize entropy?

Published on 21 Dec 2016 - 8:04

43

Views

How to solve this integral in which matrices are involved?

Published on 05 Jan 2017 - 9:03

300

Views

Proving that $\lim\limits_{k\rightarrow\infty}\frac{1}{qk}\log_2\frac{\binom{qk}{k}}{q^{k-1}}=H(\frac{1}{q})-\frac{log_2q}{q}$

Published on 09 Jan 2017 - 1:10

183

Views

Is the exponential differential Shannon entropy sub-additive?

Published on 11 Jan 2017 - 12:18

List Question

Understanding the proof of Fano's inequality

Binary symmetric channel: Why is $\sum p(x) H(Y \mid X = x) = \sum p(x) H(p)$?

Entropy of the multivariate Gaussian

Entropy function inequality

Interpreting a (function of) probability distribution as a random variable?

Fano's Inequality

Shannon's proof of entropy power inequality

Shannon Entropy

What does a `reference measure' mean in the context of defining Shannon entropy?

$I[X,Y] :=- \sum_{x,y} p(x,y)\ln{p(x,y)}$, Show that $I[X, Y] \le I[X]+I[Y]$

Is the topological entropy time-reversal invariant?

How do I maximize entropy?

How to solve this integral in which matrices are involved?

Proving that $\lim\limits_{k\rightarrow\infty}\frac{1}{qk}\log_2\frac{\binom{qk}{k}}{q^{k-1}}=H(\frac{1}{q})-\frac{log_2q}{q}$

Is the exponential differential Shannon entropy sub-additive?

Trending Questions

Popular # Hahtags

Popular Questions