Say that we have a set of 16 colors.
- If they are equiprobable, the entropy is easy to calculate an kind of intuitive
- If they aren't it is just slightly less intuitive.
However, even if one of these states is very very likely compared to the others, is there any concrete way you could show how the number of bits would be reduced when representing them (not calculation-wise but notation-wise) ?