Question

Mutual information between independent measurement of two dependent random variables

score 39 · Answer 1 · 2020-04-19 01:35:32

39

Views

Mutual information between independent measurement of two dependent random variables

Published on 19 Apr 2020 - 1:35

score 57 · Answer 2 · 2026-03-27 14:52:50

57

Views

How to calculate this entropy $H(X)=H(Y)+(p_{m-1}+p_{m})\cdot H(\frac{p_{m-1}}{p_{m-1}+p_{m}},\frac{p_{m}}{p_{m-1}+p_{m}})$

Published on 27 Mar 2026 - 14:52

score 211 · Answer 3 · 2026-03-27 08:16:48

211

Views

Concentration bound on function of the estimate

Published on 27 Mar 2026 - 8:16

score 431 · Answer 4 · 2020-04-21 00:29:43

431

Views

Distributions where the KL-Divergence is symmetric

Published on 21 Apr 2020 - 0:29

score 86 · Answer 5 · 2026-03-27 13:25:41

86

Views

How to compute $H(X \mid Y)$ and $H(Y \mid X)$ when $Y$ is fully dependent on $X$?

Published on 27 Mar 2026 - 13:25

score 22 · Answer 6 · 2020-04-22 07:46:47

22

Views

Importance of the binary channel

Published on 22 Apr 2020 - 7:46

score 270 · Answer 7 · 2020-04-22 07:48:08

270

Views

Mutual Information between discrete and continuous variable in deep learning

Published on 22 Apr 2020 - 7:48

score 34 · Answer 8 · 2026-03-29 20:27:25

34

Views

Finding the unitary matrix that minimizes an objective function based on singular values

Published on 29 Mar 2026 - 20:27

score 3.7k · Answer 9 · 2020-04-23 18:26:20

3.7k

Views

Reconciling Donsker-Varadhan definition of KL divergence with the "usual" definition

Published on 23 Apr 2020 - 18:26

score 65 · Answer 10 · 2020-04-24 16:08:28

65

Views

How to prove that $\mathrm{Prob}(\sum_{i=1}^nX_i \leq np) \leq 2^{-nD(p||q)}$?

Published on 24 Apr 2020 - 16:08

score 251 · Answer 11 · 2026-03-27 13:18:41

251

Views

Proof of source coding theorem using asymptotic equipartition property(AEP)

Published on 27 Mar 2026 - 13:18

score 223 · Answer 12 · 2026-03-25 17:26:13

223

Views

Nash equilibrium concept and fixed poind theorems

Published on 25 Mar 2026 - 17:26

score 69 · Answer 13 · 2026-03-25 14:26:59

69

Views

How might I understand the mathematical representations of model complexity and accuracy in information theory?

Published on 25 Mar 2026 - 14:26

score 637 · Answer 14 · 2026-03-27 13:25:40

637

Views

How to show the conditional entropy $H(Y|X)$ is equal to $H(X+Y|X)$?

Published on 27 Mar 2026 - 13:25

score 62 · Answer 15 · 2020-04-29 00:24:59

62

Views

Can entropy be interpreted/defined as some kind of information content?

Published on 29 Apr 2020 - 0:24

List Question

Mutual information between independent measurement of two dependent random variables

How to calculate this entropy $H(X)=H(Y)+(p_{m-1}+p_{m})\cdot H(\frac{p_{m-1}}{p_{m-1}+p_{m}},\frac{p_{m}}{p_{m-1}+p_{m}})$

Concentration bound on function of the estimate

Distributions where the KL-Divergence is symmetric

How to compute $H(X \mid Y)$ and $H(Y \mid X)$ when $Y$ is fully dependent on $X$?

Importance of the binary channel

Mutual Information between discrete and continuous variable in deep learning

Finding the unitary matrix that minimizes an objective function based on singular values

Reconciling Donsker-Varadhan definition of KL divergence with the "usual" definition

How to prove that $\mathrm{Prob}(\sum_{i=1}^nX_i \leq np) \leq 2^{-nD(p||q)}$?

Proof of source coding theorem using asymptotic equipartition property(AEP)

Nash equilibrium concept and fixed poind theorems

How might I understand the mathematical representations of model complexity and accuracy in information theory?

How to show the conditional entropy $H(Y|X)$ is equal to $H(X+Y|X)$?

Can entropy be interpreted/defined as some kind of information content?

Trending Questions

Popular # Hahtags

Popular Questions