What is The highest number of information bits $N_b$ and the smallest number of bits?

88 Views Asked by At

I want to find the highest number of information bits $N_b$ that can be reliably transmitted over a binary symmetric channel (BSC) with fixed channel parameters, error probability $ \sigma$ = range from $ 0-0.5$, and channel uses $N_c = 100$ bits.

The next question is to find the smallest number of bits $N_b$ that is required for representing $N_s $ source symbols $s$ for the source distribution and k-bit quantizer.

Is the highest number of information bits related to the entropy of the source symbols? and What are the formulas to calculate these quantities?