Question

Prove that a uniquely decodable binary scheme hast the average code word length $l = H(S)$ iff all $p_i$ are powers of $\frac{1}{2}$.

score 31 · Answer 1 · 2023-04-24 16:06:47

Prove that a uniquely decodable binary scheme hast the average code word length $l = H(S)$ iff all $p_i$ are powers of $\frac{1}{2}$.

score 24 · Answer 2 · 2026-03-25 10:52:50

24

Views

Estimation of distibution entropy based on a large sample

Published on 25 Mar 2026 - 10:52

score 67 · Answer 3 · 2026-03-26 04:32:08

67

Views

About Jensen’s inequality and Fano’s inequality

Published on 26 Mar 2026 - 4:32

score 37 · Answer 4 · 2023-04-28 10:20:45

37

Views

SMB Theorem/AEP for stationary and ergodic continuous-valued process

Published on 28 Apr 2023 - 10:20

score 73 · Answer 5 · 2023-04-28 15:05:17

73

Views

Inequality of entropies under convolution on groups

Published on 28 Apr 2023 - 15:05

score 85 · Answer 6 · 2023-05-02 20:10:05

85

Views

Is there an Intuitive Way to Remember Chain Rules or Entropy with 3+ variables

Published on 02 May 2023 - 20:10

score 83 · Answer 7 · 2023-05-05 19:01:46

83

Views

Building a Model of Probability Progression in Mastermind

Published on 05 May 2023 - 19:01

score 85 · Answer 8 · 2023-05-06 18:40:33

85

Views

Find entropy of $p = \frac{1 + \delta}{2}$, where $|\delta| < 1$

Published on 06 May 2023 - 18:40

score 74 · Answer 9 · 2023-05-06 20:43:08

74

Views

The implication of $H(X_1,X_2,\dots,X_n) = nH(X_1)$

Published on 06 May 2023 - 20:43

score 108 · Answer 10 · 2023-05-06 23:17:19

108

Views

How does the choice of alphabet impact the Shannon entropy of a sequence (if at all)?

Published on 06 May 2023 - 23:17

score 20 · Answer 11 · 2023-05-14 10:33:54

20

Views

Effective computability of non-linear optimization algorithms

Published on 14 May 2023 - 10:33

score 97 · Answer 12 · 2023-05-16 20:43:47

97

Views

Maximise entropy if we know the expected value of the distribution

Published on 16 May 2023 - 20:43

score 80 · Answer 13 · 2023-05-19 09:18:24

80

Views

Entropy reduction

Published on 19 May 2023 - 9:18

score 66 · Answer 14 · 2023-05-20 21:46:21

66

Views

Bernoulli Shift has complete positive entropy without using K-automorphism property

Published on 20 May 2023 - 21:46

score 95 · Answer 15 · 2023-05-21 08:02:22

95

Views

Is $H(f(X))$ a concave function in $p(x)$?

Published on 21 May 2023 - 8:02

List Question

Prove that a uniquely decodable binary scheme hast the average code word length $l = H(S)$ iff all $p_i$ are powers of $\frac{1}{2}$.

Estimation of distibution entropy based on a large sample

About Jensen’s inequality and Fano’s inequality

SMB Theorem/AEP for stationary and ergodic continuous-valued process

Inequality of entropies under convolution on groups

Is there an Intuitive Way to Remember Chain Rules or Entropy with 3+ variables

Building a Model of Probability Progression in Mastermind

Find entropy of $p = \frac{1 + \delta}{2}$, where $|\delta| < 1$

The implication of $H(X_1,X_2,\dots,X_n) = nH(X_1)$

How does the choice of alphabet impact the Shannon entropy of a sequence (if at all)?

Effective computability of non-linear optimization algorithms

Maximise entropy if we know the expected value of the distribution

Entropy reduction

Bernoulli Shift has complete positive entropy without using K-automorphism property

Is $H(f(X))$ a concave function in $p(x)$?

Trending Questions

Popular # Hahtags

Popular Questions