Information theory entropy equation

351 Views Asked by At

I'm studying information theory, and working through this document. On page 17, it shows that, with the function that gets the entropy of a probability $I$ and a probability $p$, that $I(p^a) = a * I(p)$. I can follow how this was derived from the axioms given, however I can't understand why $I(p^a) = a * I(p)$ means $I(p) = -log_b(p) = log_b(1/p)$. Could someone explain this?

1

There are 1 best solutions below

2
On

$\log_{b}(p^a)=a\log_{b}(p) $.
There are no other solutions over the positive reals because given any positive $x,c$ with $I(x)=c$ and $x\not=1$ all positive real numbers $r$ can be expressed uniquely as a power of $x$ and $I(r)$ is then uniquely determined.