Question

Conditional Entropy sum of 2 dice rolls and even/uneven

score 367 · Answer 1 · 2026-03-26 03:11:28

367

Views

Conditional Entropy sum of 2 dice rolls and even/uneven

Published on 26 Mar 2026 - 3:11

score 52 · Answer 2 · 2019-05-19 03:12:58

52

Views

Tricky information inequality $I(X;Z) \geq H(T)$

Published on 19 May 2019 - 3:12

score 342 · Answer 3 · 2026-03-26 06:17:45

342

Views

Expected Hamming distance between typical strings

Published on 26 Mar 2026 - 6:17

score 28 · Answer 4 · 2019-05-20 18:48:10

28

Views

Why is the KL divergence the number of bits required to represent the error of an estimator?

Published on 20 May 2019 - 18:48

score 66 · Answer 5 · 2019-05-21 11:05:46

66

Views

Proving the Asymptotic Equipartition Property (AEP) for i.i.d. random variables

Published on 21 May 2019 - 11:05

score 94 · Answer 6 · 2026-03-26 14:34:34

94

Views

Does the generator polynomial in Golay-23 divide the $(x^5+x+1)^k$ for any $k$?

Published on 26 Mar 2026 - 14:34

score 154 · Answer 7 · 2026-03-26 03:12:38

154

Views

How to argue why one dice is more rigged than the other?

Published on 26 Mar 2026 - 3:12

score 1.7k · Answer 8 · 2019-05-24 18:28:46

1.7k

Views

Meaning of negative mutual information

Published on 24 May 2019 - 18:28

score 777 · Answer 9 · 2026-03-26 04:52:26

777

Views

Minimum number of bits required for transmission?

Published on 26 Mar 2026 - 4:52

score 78 · Answer 10 · 2026-03-26 04:48:30

78

Views

'Knowing' and 'Learning' a Random Variable

Published on 26 Mar 2026 - 4:48

score 108 · Answer 11 · 2026-03-26 03:11:05

108

Views

I am getting $H(1/8,7/8) = 0.16$ while the solution says $H(1/8,7/8) = 0.544$ bits

Published on 26 Mar 2026 - 3:11

score 286 · Answer 12 · 2026-03-26 14:42:28

286

Views

Error probability of repetition code on channel introducing a fixed number of errors

Published on 26 Mar 2026 - 14:42

score 148 · Answer 13 · 2026-03-26 03:13:28

148

Views

What is the entropy of a random variable $X$ which denotes the number of rolls of a fair die required to get an outcome less than or equal to $3$

Published on 26 Mar 2026 - 3:13

score 56 · Answer 14 · 2026-03-26 04:51:15

56

Views

Take average of conditional entropy function over different value of p

Published on 26 Mar 2026 - 4:51

score 145 · Answer 15 · 2026-03-26 04:53:49

145

Views

Entropy of random variable which denotes the number of heads landed after 3 coin flips

Published on 26 Mar 2026 - 4:53

List Question

Conditional Entropy sum of 2 dice rolls and even/uneven

Tricky information inequality $I(X;Z) \geq H(T)$

Expected Hamming distance between typical strings

Why is the KL divergence the number of bits required to represent the error of an estimator?

Proving the Asymptotic Equipartition Property (AEP) for i.i.d. random variables

Does the generator polynomial in Golay-23 divide the $(x^5+x+1)^k$ for any $k$?

How to argue why one dice is more rigged than the other?

Meaning of negative mutual information

Minimum number of bits required for transmission?

'Knowing' and 'Learning' a Random Variable

I am getting $H(1/8,7/8) = 0.16$ while the solution says $H(1/8,7/8) = 0.544$ bits

Error probability of repetition code on channel introducing a fixed number of errors

What is the entropy of a random variable $X$ which denotes the number of rolls of a fair die required to get an outcome less than or equal to $3$

Take average of conditional entropy function over different value of p

Entropy of random variable which denotes the number of heads landed after 3 coin flips

Trending Questions

Popular # Hahtags

Popular Questions