List questions from information-theory

Published on 19 Aug 2013 - 6:56

1.8k

Views

What is information theoretic entropy and its physical significance?

Published on 30 Mar 2026 - 8:43

3.1k

Views

confused about joint mutual information

Published on 02 Sep 2013 - 7:11

5.1k

Views

KL divergence of multinomial distribution

Published on 05 Apr 2026 - 16:40

255

Views

Transformation of mutual information to probability distribution

Published on 06 Sep 2013 - 23:36

1k

Views

Is mutual information transitive?

Published on 30 Mar 2026 - 10:25

133

Views

How much information do you get if you draw a red card?

Published on 30 Mar 2026 - 10:25

2.8k

Views

Is maximizing entropy equivalent to minimizing the defined variance?

Published on 17 Sep 2013 - 6:29

3.1k

Views

Maximum entropy joint distribution from marginals?

Published on 30 Mar 2026 - 10:25

1.1k

Views

Card drawing algorithm

Published on 19 Sep 2013 - 7:50

944

Views

A tight lower bound for the entropy of the XOR of two random variables

Published on 30 Mar 2026 - 10:33

1.1k

Views

What is the reasoning behind the definition of relative entropy?

Published on 30 Mar 2026 - 10:25

491

Views

Show that entropy $(p1,...,pi,...,pj,...,pm)$, < entropy $(p1,..., (pi+pj)/2 ,..., (pi+pj)/2 ,...,pm)$.

Published on 25 Sep 2013 - 10:44

43

Views

Is $p(X \in A|\frac{Y+Z}{2}) = p(X \in A|Y,Z)?$

Published on 25 Sep 2013 - 13:47

131

Views

Is there a way to mathematically describe "surprise"?

Published on 01 Apr 2026 - 4:42

List Question

Understanding notation difference between mutual information and information divergance

What is information theoretic entropy and its physical significance?

confused about joint mutual information

KL divergence of multinomial distribution

Transformation of mutual information to probability distribution

Is mutual information transitive?

How much information do you get if you draw a red card?

Is maximizing entropy equivalent to minimizing the defined variance?

Maximum entropy joint distribution from marginals?

Card drawing algorithm

A tight lower bound for the entropy of the XOR of two random variables

What is the reasoning behind the definition of relative entropy?

Show that entropy $(p1,...,pi,...,pj,...,pm)$, < entropy $(p1,..., (pi+pj)/2 ,..., (pi+pj)/2 ,...,pm)$.

Is $p(X \in A|\frac{Y+Z}{2}) = p(X \in A|Y,Z)?$

Is there a way to mathematically describe "surprise"?

Trending Questions

Popular # Hahtags

Popular Questions