Question

Is there any differentiable function $f$ that approximates the "entropy" of a set of numbers $S$?

score 212 · Answer 1 · 2015-03-06 03:53:52

212

Views

Is there any differentiable function $f$ that approximates the "entropy" of a set of numbers $S$?

Published on 06 Mar 2015 - 3:53

score 1.8k · Answer 2 · 2015-03-09 22:37:20

1.8k

Views

How to prove H(X,Y) $\ge$ H(Z)?

Published on 09 Mar 2015 - 22:37

score 267 · Answer 3 · 2015-03-10 13:31:09

267

Views

Ratio between forward and reverse conditional probability

Published on 10 Mar 2015 - 13:31

score 147 · Answer 4 · 2015-03-11 13:22:06

147

Views

Maximum entropy distribution given second order marginals

Published on 11 Mar 2015 - 13:22

score 61 · Answer 5 · 2015-03-17 17:26:00

61

Views

For any $n\ge2$ prove that $H(X_1,X_2,...,X_n)\ge\sum\limits_{i=n}^\mathbb{n}\ H(X_i|X_j , j \neq i)$

Published on 17 Mar 2015 - 17:26

score 1k · Answer 6 · 2015-03-22 11:28:24

1k

Views

What's the maximum entropy for discrete distribution given mean and variance

Published on 22 Mar 2015 - 11:28

score 82 · Answer 7 · 2015-03-24 16:04:33

82

Views

Relative Entropy - Help please

Published on 24 Mar 2015 - 16:04

score 760 · Answer 8 · 2015-03-28 14:45:49

760

Views

Is there a means of calculating the entropy of a series of bits that takes correlation into account?

Published on 28 Mar 2015 - 14:45

score 58 · Answer 9 · 2015-03-31 23:49:17

58

Views

Application of Jensen's Inequality. Correct?

Published on 31 Mar 2015 - 23:49

score 1.4k · Answer 10 · 2015-04-01 10:00:23

1.4k

Views

What is the maximum entropy distribution over all integers (ie. including negative ones) with fixed mean and variance?

Published on 01 Apr 2015 - 10:00

score 104 · Answer 11 · 2015-04-01 21:54:52

104

Views

Required bits to communicate a partial order?

Published on 01 Apr 2015 - 21:54

score 10k · Answer 12 · 2015-04-06 10:17:29

10k

Views

Entropy for three random variables

Published on 06 Apr 2015 - 10:17

score 510 · Answer 13 · 2015-04-07 00:27:44

510

Views

a question about entropy of run length coding

Published on 07 Apr 2015 - 0:27

score 323 · Answer 14 · 2015-04-08 23:26:21

323

Views

How do I evaluate $\mathbb E(X\log(X))$ if $X$ has a binomial distribution, for large $n$ values?

Published on 08 Apr 2015 - 23:26

score 164 · Answer 15 · 2015-04-10 03:31:28

164

Views

Questions Regarding Mutual Information

Published on 10 Apr 2015 - 3:31

List Question

Is there any differentiable function $f$ that approximates the "entropy" of a set of numbers $S$?

How to prove H(X,Y) $\ge$ H(Z)?

Ratio between forward and reverse conditional probability

Maximum entropy distribution given second order marginals

For any $n\ge2$ prove that $H(X_1,X_2,...,X_n)\ge\sum\limits_{i=n}^\mathbb{n}\ H(X_i|X_j , j \neq i)$

What's the maximum entropy for discrete distribution given mean and variance

Relative Entropy - Help please

Is there a means of calculating the entropy of a series of bits that takes correlation into account?

Application of Jensen's Inequality. Correct?

What is the maximum entropy distribution over all integers (ie. including negative ones) with fixed mean and variance?

Required bits to communicate a partial order?

Entropy for three random variables

a question about entropy of run length coding

How do I evaluate $\mathbb E(X\log(X))$ if $X$ has a binomial distribution, for large $n$ values?

Questions Regarding Mutual Information

Trending Questions

Popular # Hahtags

Popular Questions