List questions from information-theory

Published on 28 Mar 2026 - 13:21

112

Views

Why do we like sticking random variables into their own distributions?

Published on 20 Apr 2016 - 20:19

125

Views

Basic Entropy Inequality and Identity question

Published on 30 Mar 2026 - 3:34

364

Views

Channel capacity of sum of symmetric channels

Published on 31 Mar 2026 - 14:11

988

Views

(Elegant) proof of : $x \log_2\frac{1}{x}+(1-x) \log_2\frac{1}{1-x} \geq 1- (1-\frac{x}{1-x})^2$

Published on 30 Mar 2026 - 3:39

781

Views

$K(xy)\leq K(x)+K(y) +c$?

Published on 31 Mar 2026 - 5:56

355

Views

For a Fisher Information, $\mathcal{I}(\theta)$, why does $\mathcal{I}(\theta) = n\mathcal{I}_1(\theta)$ not hold for multiple dimensions?

Published on 06 May 2016 - 5:09

2.3k

Views

Repetition code and binary symmetric channel, where error is near 1/2

Published on 31 Mar 2026 - 17:48

703

Views

Proof regarding size and dimension of linear codes

Published on 31 Mar 2026 - 17:47

62

Views

Comparing entropies $H((f(X,Y), g(X,Y)))$ and $H ((f(X,Y),g(X,Z)))$

Published on 30 Mar 2026 - 3:39

748

Views

Relative entropy (KL divergence) of sum of random variables

Published on 11 May 2016 - 12:07

398

Views

Maximizing sum of logarithms (Z-channel capacity)

Published on 12 May 2016 - 1:11

393

Views

On logic vs information theory

Published on 27 Mar 2026 - 4:24

285

Views

Relative entropy between discrete and continuous random variables

Published on 17 May 2016 - 15:03

1.1k

Views

Approximation of an indefinite integral

Published on 17 May 2016 - 16:13

List Question

Representation of the optimal filter measure as the measure of a diffusion process

Why do we like sticking random variables into their own distributions?

Basic Entropy Inequality and Identity question

Channel capacity of sum of symmetric channels

(Elegant) proof of : $x \log_2\frac{1}{x}+(1-x) \log_2\frac{1}{1-x} \geq 1- (1-\frac{x}{1-x})^2$

$K(xy)\leq K(x)+K(y) +c$?

For a Fisher Information, $\mathcal{I}(\theta)$, why does $\mathcal{I}(\theta) = n\mathcal{I}_1(\theta)$ not hold for multiple dimensions?

Repetition code and binary symmetric channel, where error is near 1/2

Proof regarding size and dimension of linear codes

Comparing entropies $H((f(X,Y), g(X,Y)))$ and $H ((f(X,Y),g(X,Z)))$

Relative entropy (KL divergence) of sum of random variables

Maximizing sum of logarithms (Z-channel capacity)

On logic vs information theory

Relative entropy between discrete and continuous random variables

Approximation of an indefinite integral

Trending Questions

Popular # Hahtags

Popular Questions