Question

Prove that a uniquely decodable binary scheme hast the average code word length $l = H(S)$ iff all $p_i$ are powers of $\frac{1}{2}$.

score 32 · Answer 1 · 2026-03-28 14:55:14

Prove that a uniquely decodable binary scheme hast the average code word length $l = H(S)$ iff all $p_i$ are powers of $\frac{1}{2}$.

score 57 · Answer 2 · 2026-02-23 13:40:39

57

Views

Maximum entropy for a power constrained distribution.

Published on 23 Feb 2026 - 13:40

score 67 · Answer 3 · 2026-03-26 04:32:08

67

Views

About Jensen’s inequality and Fano’s inequality

Published on 26 Mar 2026 - 4:32

score 38 · Answer 4 · 2026-03-28 14:53:43

38

Views

SMB Theorem/AEP for stationary and ergodic continuous-valued process

Published on 28 Mar 2026 - 14:53

score 43 · Answer 5 · 2026-04-02 09:05:19

43

Views

Estimating entropy rates conditioned on typical sets

Published on 02 Apr 2026 - 9:05

score 61 · Answer 6 · 2026-03-29 07:37:29

61

Views

understanding interleaving of noise and i.i.d. noise in communication problem

Published on 29 Mar 2026 - 7:37

score 186 · Answer 7 · 2026-03-25 19:03:30

186

Views

Compact Way of Storing Chess State Information

Published on 25 Mar 2026 - 19:03

score 48 · Answer 8 · 2026-03-26 01:10:48

48

Views

Does Han-Kobayashi attain the maximal rate-sum of a discrete memoryless very weak interference channel?

Published on 26 Mar 2026 - 1:10

score 86 · Answer 9 · 2026-03-28 14:54:10

86

Views

Is there an Intuitive Way to Remember Chain Rules or Entropy with 3+ variables

Published on 28 Mar 2026 - 14:54

score 50 · Answer 10 · 2023-05-03 05:58:58

50

Views

Conditional Information

Published on 03 May 2023 - 5:58

score 51 · Answer 11 · 2023-05-04 07:01:37

51

Views

Simplifying $I(X;CX+Y)$

Published on 04 May 2023 - 7:01

score 84 · Answer 12 · 2026-03-28 14:55:29

84

Views

Building a Model of Probability Progression in Mastermind

Published on 28 Mar 2026 - 14:55

score 69 · Answer 13 · 2026-04-02 11:44:42

69

Views

Why is the KL Divergence between contracted $Bin(N,\theta)$ and $Bernoulli(\lambda)$ convex function in $\lambda$?

Published on 02 Apr 2026 - 11:44

score 91 · Answer 14 · 2026-04-01 14:10:20

91

Views

Efficient code for "Codenames" board game

Published on 01 Apr 2026 - 14:10

score 86 · Answer 15 · 2026-03-28 14:55:16

86

Views

Find entropy of $p = \frac{1 + \delta}{2}$, where $|\delta| < 1$

Published on 28 Mar 2026 - 14:55

List Question

Prove that a uniquely decodable binary scheme hast the average code word length $l = H(S)$ iff all $p_i$ are powers of $\frac{1}{2}$.

Maximum entropy for a power constrained distribution.

About Jensen’s inequality and Fano’s inequality

SMB Theorem/AEP for stationary and ergodic continuous-valued process

Estimating entropy rates conditioned on typical sets

understanding interleaving of noise and i.i.d. noise in communication problem

Compact Way of Storing Chess State Information

Does Han-Kobayashi attain the maximal rate-sum of a discrete memoryless very weak interference channel?

Is there an Intuitive Way to Remember Chain Rules or Entropy with 3+ variables

Conditional Information

Simplifying $I(X;CX+Y)$

Building a Model of Probability Progression in Mastermind

Why is the KL Divergence between contracted $Bin(N,\theta)$ and $Bernoulli(\lambda)$ convex function in $\lambda$?

Efficient code for "Codenames" board game

Find entropy of $p = \frac{1 + \delta}{2}$, where $|\delta| < 1$

Trending Questions

Popular # Hahtags

Popular Questions