Question

The motivation of continuous random variable mutual information by $k$'th nearest neighbour

score 644 · Answer 1 · 2026-04-17 02:06:19

644

Views

The motivation of continuous random variable mutual information by $k$'th nearest neighbour

Published on 17 Apr 2026 - 2:06

score 332 · Answer 2 · 2026-04-14 12:07:50

332

Views

Trace of a matrix exponential with tensor products, and Von Neumann entropy

Published on 14 Apr 2026 - 12:07

score 125 · Answer 3 · 2026-04-14 02:11:14

125

Views

Effect of a convolution with a Bernoulli distribution on Rényi divergence

Published on 14 Apr 2026 - 2:11

score 562 · Answer 4 · 2026-05-10 17:58:20

562

Views

Prove 0<=entropy<=1

Published on 10 May 2026 - 17:58

score 205 · Answer 5 · 2026-04-12 09:13:15

205

Views

Calculating the capacity of a noisy channel

Published on 12 Apr 2026 - 9:13

score 4.6k · Answer 6 · 2026-04-15 05:56:10

4.6k

Views

Negative Entropy $x\log x$ is convex

Published on 15 Apr 2026 - 5:56

score 295 · Answer 7 · 2026-04-15 06:10:12

295

Views

Oleinik condition is equivalent to Entropy Condition (PDE)

Published on 15 Apr 2026 - 6:10

score 392 · Answer 8 · 2026-04-12 05:58:54

392

Views

Mutual information with two independent variables

Published on 12 Apr 2026 - 5:58

score 632 · Answer 9 · 2026-04-08 17:10:13

632

Views

is Shannons "A mathematical theory of communication" worth reading for a beginner in information theory?

Published on 08 Apr 2026 - 17:10

score 328 · Answer 10 · 2026-04-16 11:33:40

328

Views

Mutual information between dependent and independent variables

Published on 16 Apr 2026 - 11:33

score 127 · Answer 11 · 2026-04-14 00:53:56

127

Views

Shannon Entropy of a periodic signal

Published on 14 Apr 2026 - 0:53

score 139 · Answer 12 · 2026-04-10 13:33:44

139

Views

Binary Entropy Function (properties)

Published on 10 Apr 2026 - 13:33

score 204 · Answer 13 · 2026-04-12 13:24:38

204

Views

asymptotics for binomials

Published on 12 Apr 2026 - 13:24

score 119 · Answer 14 · 2026-04-14 04:43:43

119

Views

can mutual entropy be higher than joint entropy?

Published on 14 Apr 2026 - 4:43

score 1.8k · Answer 15 · 2026-04-12 06:47:16

1.8k

Views

Entropy of a normal distribution in Bits versus Nats in book Elements of Information Theory

Published on 12 Apr 2026 - 6:47

List Question

The motivation of continuous random variable mutual information by $k$'th nearest neighbour

Trace of a matrix exponential with tensor products, and Von Neumann entropy

Effect of a convolution with a Bernoulli distribution on Rényi divergence

Prove 0<=entropy<=1

Calculating the capacity of a noisy channel

Negative Entropy $x\log x$ is convex

Oleinik condition is equivalent to Entropy Condition (PDE)

Mutual information with two independent variables

is Shannons "A mathematical theory of communication" worth reading for a beginner in information theory?

Mutual information between dependent and independent variables

Shannon Entropy of a periodic signal

Binary Entropy Function (properties)

asymptotics for binomials

can mutual entropy be higher than joint entropy?

Entropy of a normal distribution in Bits versus Nats in book Elements of Information Theory

Trending Questions

Popular # Hahtags

Popular Questions