Here's a problem from Sheldon Ross's A First Course in Probability that I don't understand:
At a certain stage of a criminal investigation, the inspector in charge is 60 percent convinced of the guilt of a certain suspect. Suppose, however, that a new piece of evidence which shows that the criminal has a certain characteristic (such as left-handedness, baldness, or brown hair) is uncovered. If 20 percent of the population possesses this characteristic, how certain of the guilt of the suspect should the inspector now be if it turns out that the suspect has the characteristic?
The solution is:
Letting $G$ denote the event that the suspect is guilty and $C$ the event that he possesses the characteristic of the criminal, we have $$ P(G\mid C) = \frac{P(GC)}{P(C)} = \frac{P(C\mid G)P(G)}{P(C\mid G)P(G) + P(C\mid G^c)P(G^c)} = \frac{1(0.6)}{1(0.6) + (0.2)(0.4)} = 0.882 $$
What I don't understand is why $P(C) = P(C\mid G)P(G) + P(C\mid G^c)P(G^c)$. I feel that it should be either 1, if the suspect has the characteristic, else 0.2 if it's unknown. If someone could explain how this is derived, I'd really appreciate it.
$$\begin{align}P(C) & = P(C\mid G)P(G) + P(C\mid G^c)P(G^c) \\ & = P(C \cap G) + P(C \cap G^c)\end{align}$$
$P(C)$ is the measure of the inspector's belief that the suspect would possess the characteristic prior to examination. It is equal to the inspector's belief they could possess the characteristic and be guilty, plus the inspector's belief that they could possess the characteristic and be innocent.
Your instinct that the value is either $1$ for someone who is guilty, or $0.20$ for someone who is not, is why we assign those values to $P(C\mid G) = 1$ and $P(C\mid G^c) = 0.2$.
We then multiply each of these by the inspector's prior belief that the particular suspect is guilty or innocent (as appropriate) and add these together to obtain the inspector's prior belief that the suspect could have the characteristic.
$\begin{align}P(C) & = P(C\mid G)P(G) + P(C\mid G^c)P(G^c) \\ & = (1)(0.6)+(0.2)(0.4) \\ ~ & = 0.68 \end{align}$
This is then used to update the inspector's belief in the suspect's guilt posterior to discovering that the suspect does have that characteristic.
$$P(G\mid C) = \frac{P(G)P(C\mid G)}{P(C)}$$