Question

I need help understanding proofs of Gibbs' Inequality using Jensen's Inequality.

score 3.5k · Answer 1 · 2016-12-20 20:41:14

3.5k

Views

I need help understanding proofs of Gibbs' Inequality using Jensen's Inequality.

Published on 20 Dec 2016 - 20:41

score 628 · Answer 2 · 2016-12-21 20:57:18

628

Views

Conditional mutual information of one random variable conditioned on two other random variables

Published on 21 Dec 2016 - 20:57

score 83 · Answer 3 · 2016-12-22 01:30:04

83

Views

Does mutual dependency implies $I(X;Y|Z) \le I(X;Y)$?

Published on 22 Dec 2016 - 1:30

score 197 · Answer 4 · 2026-03-25 14:21:36

197

Views

Hash function that can determine set similarity

Published on 25 Mar 2026 - 14:21

score 44 · Answer 5 · 2016-12-27 23:02:07

44

Views

Linear Applications applied to Information Tecnologies?

Published on 27 Dec 2016 - 23:02

score 91 · Answer 6 · 2026-03-26 06:33:54

91

Views

Complexity of a constrain-modified $0$-$1$-knapsack problem

Published on 26 Mar 2026 - 6:33

score 177 · Answer 7 · 2026-03-28 08:33:25

177

Views

Please, clarify relationship between Hausdorff dimension and storage space of points in Cantor sets.

Published on 28 Mar 2026 - 8:33

score 173 · Answer 8 · 2026-03-30 15:46:46

173

Views

the output dependency of DMC channel when the input components are independent with each other.

Published on 30 Mar 2026 - 15:46

score 184 · Answer 9 · 2026-03-28 06:23:31

184

Views

Is the exponential differential Shannon entropy sub-additive?

Published on 28 Mar 2026 - 6:23

score 274 · Answer 10 · 2026-03-28 19:35:55

274

Views

Is this a possible multivariate generalization of pointwise Mutual Information? If so, how can it be formalized?

Published on 28 Mar 2026 - 19:35

score 61 · Answer 11 · 2017-01-16 22:26:27

61

Views

Proof of mutual information property that $I((1-\beta)Z + \beta X; X) \geq I(Z; X)$

Published on 16 Jan 2017 - 22:26

score 1.9k · Answer 12 · 2026-04-01 15:49:38

1.9k

Views

Complexity of inversion counting

Published on 01 Apr 2026 - 15:49

score 554 · Answer 13 · 2026-03-29 17:25:13

554

Views

Reference for information theory and bayesian inference

Published on 29 Mar 2026 - 17:25

score 159 · Answer 14 · 2017-01-19 19:14:33

159

Views

How do taylor expansions map a set of countable coefficients to a function that exists on an uncountable set of points?

Published on 19 Jan 2017 - 19:14

score 246 · Answer 15 · 2026-03-26 20:25:49

246

Views

Chaitin's constant and coding undecidable propositions in a number

Published on 26 Mar 2026 - 20:25

List Question

I need help understanding proofs of Gibbs' Inequality using Jensen's Inequality.

Conditional mutual information of one random variable conditioned on two other random variables

Does mutual dependency implies $I(X;Y|Z) \le I(X;Y)$?

Hash function that can determine set similarity

Linear Applications applied to Information Tecnologies?

Complexity of a constrain-modified $0$-$1$-knapsack problem

Please, clarify relationship between Hausdorff dimension and storage space of points in Cantor sets.

the output dependency of DMC channel when the input components are independent with each other.

Is the exponential differential Shannon entropy sub-additive?

Is this a possible multivariate generalization of pointwise Mutual Information? If so, how can it be formalized?

Proof of mutual information property that $I((1-\beta)Z + \beta X; X) \geq I(Z; X)$

Complexity of inversion counting

Reference for information theory and bayesian inference

How do taylor expansions map a set of countable coefficients to a function that exists on an uncountable set of points?

Chaitin's constant and coding undecidable propositions in a number

Trending Questions

Popular # Hahtags

Popular Questions