How can be proven that the entropy of a dice roll is maximized when the probability of each of its $6$ faces is equal, $1/6$?
2026-03-31 14:12:57.1774966377
On
Prove that entropy is maximized when probability is $1/n$
505 Views Asked by Bumbble Comm https://math.techqa.club/user/bumbble-comm/detail At
2
There are 2 best solutions below
1
On
The entropy is given by $-\sum p_i\ln p_i$. Use Jensen's inequality with the logarithm function.
Suprise is defined as -log(p{X=x}). A good way to think of entropy is the "expected surprise". In this sense, its easy to see that the uniform distribution maximizes the expected surprise.