Question

Can conditional entropy $H(Y\mid X)$ be expressed by Kullback-Leibler divergence as $-D_{KL}\left(p(X,Y) \parallel p(X)\right)$?

score 2.5k · Answer 1 · 2017-04-06 16:31:39

2.5k

Views

Can conditional entropy $H(Y\mid X)$ be expressed by Kullback-Leibler divergence as $-D_{KL}\left(p(X,Y) \parallel p(X)\right)$?

Published on 06 Apr 2017 - 16:31

score 1.2k · Answer 2 · 2017-04-07 15:46:09

1.2k

Views

Entropy of a matrix?

Published on 07 Apr 2017 - 15:46

score 248 · Answer 3 · 2017-04-07 21:07:11

248

Views

Approximation of binary entropy function where weighted sum has minimum at same input

Published on 07 Apr 2017 - 21:07

score 174 · Answer 4 · 2026-03-27 00:04:21

174

Views

Finding the rate distortion function

Published on 27 Mar 2026 - 0:04

score 52 · Answer 5 · 2023-02-01 11:50:42

52

Views

In the discrete case (or bounded support?) why the distribution maximising the entropy is uniform while it is the gaussian in the class of fixed std?

Published on 01 Feb 2023 - 11:50

score 122 · Answer 6 · 2023-02-04 10:12:50

122

Views

Maximum Entropy with Inequality Constraints

Published on 04 Feb 2023 - 10:12

score 42 · Answer 7 · 2023-02-05 20:38:04

42

Views

Entropy calculation of splitted experiment

Published on 05 Feb 2023 - 20:38

score 330 · Answer 8 · 2023-02-06 13:42:32

330

Views

Upper Bounding the Discrete Entropy by the Expectation

Published on 06 Feb 2023 - 13:42

score 47 · Answer 9 · 2023-02-08 17:47:23

47

Views

Convergence with occasional model misspecification

Published on 08 Feb 2023 - 17:47

score 27 · Answer 10 · 2023-02-20 10:21:19

27

Views

Set of states with unequal probability where you can use less bits

Published on 20 Feb 2023 - 10:21

score 206 · Answer 11 · 2023-02-14 02:40:34

206

Views

Finding a continuous distribution that maximizes differential entropy

Published on 14 Feb 2023 - 2:40

score 188 · Answer 12 · 2023-02-28 10:13:55

188

Views

Number of bits from entropy calculations

Published on 28 Feb 2023 - 10:13

score 91 · Answer 13 · 2026-02-23 13:40:33

91

Views

Compute functional from its first variation

Published on 23 Feb 2026 - 13:40

score 81 · Answer 14 · 2023-03-04 18:20:06

81

Views

Wallis' derivation of information entropy

Published on 04 Mar 2023 - 18:20

score 149 · Answer 15 · 2023-03-05 15:55:23

149

Views

Is a entropy the higher the better or the lower the better?

Published on 05 Mar 2023 - 15:55

List Question

Can conditional entropy $H(Y\mid X)$ be expressed by Kullback-Leibler divergence as $-D_{KL}\left(p(X,Y) \parallel p(X)\right)$?

Entropy of a matrix?

Approximation of binary entropy function where weighted sum has minimum at same input

Finding the rate distortion function

In the discrete case (or bounded support?) why the distribution maximising the entropy is uniform while it is the gaussian in the class of fixed std?

Maximum Entropy with Inequality Constraints

Entropy calculation of splitted experiment

Upper Bounding the Discrete Entropy by the Expectation

Convergence with occasional model misspecification

Set of states with unequal probability where you can use less bits

Finding a continuous distribution that maximizes differential entropy

Number of bits from entropy calculations

Compute functional from its first variation

Wallis' derivation of information entropy

Is a entropy the higher the better or the lower the better?

Trending Questions

Popular # Hahtags

Popular Questions