Question

Does entropy $H(y)$ decrease as $H(x,y)$ decreases when $H(x)$ is fixed?

score 100 · Answer 1 · 2026-03-26 12:32:03

100

Views

Does entropy $H(y)$ decrease as $H(x,y)$ decreases when $H(x)$ is fixed?

Published on 26 Mar 2026 - 12:32

score 85 · Answer 2 · 2026-03-26 12:38:03

85

Views

For P0 close to P1 the relative entropy can be approximated by its series expansion,Why?

Published on 26 Mar 2026 - 12:38

score 127 · Answer 3 · 2014-03-26 14:55:25

127

Views

Mutual information and Independence

Published on 26 Mar 2014 - 14:55

score 1.9k · Answer 4 · 2014-03-28 13:03:37

1.9k

Views

How to make the encoding of symbols needs only 1.58496 bits/symbol as carried out in theory?

Published on 28 Mar 2014 - 13:03

score 144 · Answer 5 · 2014-03-30 02:04:16

144

Views

An inequality about entropy

Published on 30 Mar 2014 - 2:04

score 858 · Answer 6 · 2026-03-25 09:29:05

858

Views

In the Stinespring dilation theorem, what is the minimum dimension for which a dilation Hilbert space of this form is guaranteed to exist?

Published on 25 Mar 2026 - 9:29

score 945 · Answer 7 · 2026-03-26 12:32:27

945

Views

Shannon Entropy Minimization

Published on 26 Mar 2026 - 12:32

score 52 · Answer 8 · 2026-03-27 04:34:32

52

Views

information and coding theory weakly independent problem

Published on 27 Mar 2026 - 4:34

score 865 · Answer 9 · 2026-03-26 04:53:16

865

Views

The golden ratio in statistics of literature

Published on 26 Mar 2026 - 4:53

score 352 · Answer 10 · 2026-03-25 06:29:20

352

Views

Why can we use entropy to measure the quality of a language model?

Published on 25 Mar 2026 - 6:29

score 99 · Answer 11 · 2026-03-25 04:40:31

99

Views

How much information is in the question "How much information is in this question?"?

Published on 25 Mar 2026 - 4:40

score 997 · Answer 12 · 2026-03-26 11:05:03

997

Views

Looking for a a measure-theoretic treatment of "differential entropy"

Published on 26 Mar 2026 - 11:05

score 109 · Answer 13 · 2014-04-10 23:40:24

109

Views

What's the name of the quantity $\mathbb{P}(A\cap B)/(\mathbb{P}(A)\mathbb{P}(B))\;$?

Published on 10 Apr 2014 - 23:40

score 166 · Answer 14 · 2026-03-25 09:22:53

166

Views

Loss of information while projecting multidimensional data

Published on 25 Mar 2026 - 9:22

score 1.2k · Answer 15 · 2014-04-13 01:44:27

1.2k

Views

Conditional mutual information and Markov chain.

Published on 13 Apr 2014 - 1:44

List Question

Does entropy $H(y)$ decrease as $H(x,y)$ decreases when $H(x)$ is fixed?

For P0 close to P1 the relative entropy can be approximated by its series expansion,Why?

Mutual information and Independence

How to make the encoding of symbols needs only 1.58496 bits/symbol as carried out in theory?

An inequality about entropy

In the Stinespring dilation theorem, what is the minimum dimension for which a dilation Hilbert space of this form is guaranteed to exist?

Shannon Entropy Minimization

information and coding theory weakly independent problem

The golden ratio in statistics of literature

Why can we use entropy to measure the quality of a language model?

How much information is in the question "How much information is in this question?"?

Looking for a a measure-theoretic treatment of "differential entropy"

What's the name of the quantity $\mathbb{P}(A\cap B)/(\mathbb{P}(A)\mathbb{P}(B))\;$?

Loss of information while projecting multidimensional data

Conditional mutual information and Markov chain.

Trending Questions

Popular # Hahtags

Popular Questions