Exam with $12$ yes/no questions (half yes, half no) and $8$ correct needed to pass, is it better to answer randomly or answer exactly 6 times yes?

Question

In an exam with $12$ yes/no questions with $8$ correct needed to pass, is it better to answer randomly or answer exactly $6$ times yes and 6 times no, given that the answer 'yes' is correct for exactly $6$ questions?

I have calculated the probability of passing by guessing randomly and it is

$$\sum_{k=8}^{12} {{12}\choose{k}}0.5^k0.5^{n-k}=0.194$$

Now given that the answer 'yes' is right exactly $6$ times, is it better to guess 'yes' and 'no' $6$ times each?

My idea is that it can be modelled by drawing balls without replacement. The balls we draw are the correct answers to the questions.

Looking at the first question, we still know that there are $6$ yes and no's that are correct. The chance that a yes is right is $\frac{6}{12}$ and the chance that a no is right is also $\frac{6}{12}$.

Of course the probability in the next question depends on what the first right answer was. If yes was right, yes will be right with a probability of $5/11$ and a no is right with the chance $6/11$. If no was right, the probabilities would change places.

Now that we have to make the choice $12$ times and make the distinction which one was right, we get $2^{12}$ paths total. We cannot know what the correct answers to the previous questions were. So we are drawing $12$ balls at once, but from what urn? It cannot contain $24$ balls with $12$ yes and $12$ no's. Is this model even correct?

Is there a more elegant way to approach that?

I am asking for hints, not solutions, as I'm feeling stuck. Thank you.

---

Edit: After giving @David K's answer more thought, I noticed that the question can be described by the hypergeometric distribution, which yields the desired result.

Answer 1

We are given the fact that there are $12$ questions, that $6$ have the correct answer "yes" and $6$ have the correct answer "no."

There are $\binom{12}{6} = 924$ different sequences of $6$ "yes" answers and $6$ "no" answers. If we know nothing that will give us a better chance of answering any question correctly than sheer luck, the most reasonable assumption is that every possible sequence of answers is equally likely, that is, each one has $\frac{1}{924}$ chance to occur.

So guess "yes" $6$ times and "no" $6$ times. I do not care how you do that: you may guess "yes" for the first $6$, or flip a coin and answer "yes" for heads and "no" for tails until you have used up either the $6$ "yeses" or the $6$ "noes" and the rest of your answers are forced, or you can put $6$ balls labeled "yes" and $6$ labeled "no" in an urn, draw them one at a time, and answer the questions in that sequence.

No matter what you do, you end up with some sequence of "yes" $6$ times and "no" $6$ times. You get $12$ correct if and only if the sequence of correct answers is exactly the same as your sequence. That probability is $\frac{1}{924}.$

There is no way for you to get $11$ correct. You get $10$ correct if and only if the correct answers are "yes" on $5$ of your "yes" answers and "no" on your other "yes" answers. The number of ways this can happen is the number of ways to choose $5$ correct answers from your $6$ "yes" answers, times the number of ways to choose $5$ correct answers from your $6$ "no" answers: $\binom 65 \times \binom 65 = 36.$

There is no way for you to get $9$ correct. You get $8$ correct if and only if the correct answers are "yes" on $4$ of your "yes" answers and "no" on your other "yes" answers. The number of ways this can happen is the number of ways to choose $4$ correct answers from your $6$ "yes" answers, times the number of ways to choose $4$ correct answers from your $6$ "no" answers: $\binom 64 \times \binom 64 = 225.$

In any other case you fail. So the chance to pass is $$ \frac{1 + 36 + 225}{924} = \frac{131}{462} \approx 0.283550, $$ which is much better than the chance of passing if you simply toss a coin for each individual question but not nearly as good as getting $4$ or more heads in $6$ coin tosses.

---

Just to check, we can compute the chance of failing in the same way: $6$ answers correct ($3$ "yes" and $3$ "no"), $4$ answers correct, $2$ correct, $0$ correct. This probability comes to $$ \frac{\binom 63^2 + \binom 62^2 + \binom 61^2 + 1}{924} = \frac{400 + 225 + 36 + 1}{924} = \frac{331}{462} \approx 0.716450, $$ which is the value needed to confirm the answer above.

Answer 2

Try the following approach.

First, assume that the answerer puts "yes" for the first six and "no" for the last six. Since the order of his answers clearly cannot change his probability of passing, this is an okay assumption.

Note that if there are $x$ questions correct on the first half of the test, there are $x$ questions correct on the second half as well (think about why). So it's sufficient to get the probability that $4$ of the first $6$ answers are yes.

Now, try to calculate the probability that a randomly ordered row of $12$ balls -- $6$ "yes" balls and $6$ "no" balls -- has $4$ "yes" balls among the first $6$ balls in the row.

Answer 3

In terms of balls and urns: Maybe it helps to think about it as follows:

You have a red urn and a blue urn, and you have $6$ red balls and $6$ blue balls. You randomly put $6$ of the twelve balls in the red urn, and the other $6$ in the blue urn. Now: what it the chance that at least $8$ balls are in the 'right' (i.e. same colored) urn?

Well, to get $8$ correct, you either need to get all $6$ red balls in the red urn ($1$ possibility), or $5$ red ones and $1$ blue in the red urn (${6 \choose 5} \cdot {6 \choose 1} = 6 \cdot 6 = 36$ possibilities), or $4$ red ones and $2$ blue ones (${6 \choose 4} \cdot {6 \choose 2} = 15 \cdot 15 = 225$ possibilities). This is out of a total of ${12 \choose 6} = 924$ possibilities, and so the probability is $\frac{1+36+225}{924}$

NOTE: Thanks to @DavidK for pointing out my initial answer was wrong! Everyone please upvote his answer!

Answer 4

Brute force:

Suppose the answer has a set position of yes and no answers

Suppose you guess 6 yesses, then the rest of them you answer no.

There are ${6 \choose k}$ ways for you to have guessed $k$ of the yeses correct. If you guess $k$ yesses correctly then you have guess $6-k$ yesses incorrectly. There are $6$ nos and $6-k$ of the must be in spots where you guessed them yes incorrectly. The remaining $k$ must be in spots you guessed no. So you will have gotten $2k$ correct.

So there is ${6\choose k} $ ways to get get $2k$ out of $12$ correctly and it is impossible to get an odd number correct.

So the total ways to guess is $\sum_{k=0}^6 {6 \choose k}$ and the total ways of passing are $\sum_{k=4}^6{6\choose k}$.

So the probability of passing is $\frac {\sum_{k=4}^6{6\choose k}}{\sum_{k=0}^6 {6 \choose k}}$. As ${6 \choose k} = {6\choose 6-k}$ we know ${\sum_{k=0}^6 {6 \choose k}}= {6\choose 3} + 2\sum_{k=4}^6 {6\choose k}$

So probability of passing is $\frac {{6\choose 4}+{6\choose 5} + {6\choose 6}}{2({6\choose 4}+{6\choose 5} + {6\choose 6}) + {6\choose 3}}=\frac {15 + 6 + 1}{2(15+6+1) + 20} = \frac {22}{64} = \frac {11}{32}$ more than $1$ in $3$.

If you guess randomly:

The probability that you guess them exactly correct is $\frac 1{2^{12}}$.

The probability that you guess the first one wrong and the $2-12$ correctly is the same $\frac 1{2^{12}}$, but if you guess exactly one wrong there are $12$ possible questions that could be wrong. So the probabiblity that exactly one of your guess is wrong is $12*\frac 1{2^{12}}$.

If you guess exactly $k$ wrong there are ${12\choose k}$ ways to do this so the probability of guessing exactly $k$ wrong is ${12\choose k}\frac 1{2^{12}}$.

So to guess $0, 1,2,3$ or $4$ wrong is $\frac 1{2^{12}}({12\choose 0}+{12\choose 1}+{12\choose 2}+{12\choose 3}+{12\choose 4})=\frac 1{2^{12}}(1+12+66+220+ 495)= \frac {794}{4096} $ almost $1$ in $5$.

So first is better.

Answer 5

Suppose we reframe it as the following: we have some probability $p_r$ of passing if youwe choose randomly. We can also define $p_n$ as the probability of passing if we restrict ourselves to random assignments with exactly $n$ "yes". So your specific question is: is $p_6>p_r$? More generally, we ask "How does $n$ affect $p_n$?" If we were to assign all the questions "no", there is no way we could pass; since only 6 questions are actually "no", we can get at most 6 right. To pass, we have to assign at least 2 questions "yes". So we have $p_n = 0$ for $|n-6|>4$. We have non-zero $p_n$ for only $n$ in $\left\{2,3,4,5,6,7,8,9,10 \right\}$. Since $p_r$ is a weighted average of $p_n$ for all $n$ (including values for which $p_n =0$), the only way $p_r$ could greater than $p_6$ is if $p_6$ is less than the average $p_n$ for $|n-6|\leq4$=. Intuitively, however, $p_6$ should be at least as large as $p_n$ for any n.

Answer 6

A quick way to find the correct answer, which IMHO also gives insight into why this works better than 12 independent coin flips:

• Let $X =$ no. of correct answers if you randomly guess exactly 6 Yes and 6 No.

• As others have observed, $X \in \{0, 2, 4, 6, 8, 10, 12\}$.

• $P(X=6) = {{6 \choose 3}{6 \choose 3} \over {12 \choose 6}} = {400 \over 924} \approx 0.4329$.

• By symmetry, $P(X \ge 8) = {1 - P(X=6) \over 2} = {262 \over 924} \approx 0.2835$.

IMHO, this is ultimately why this method works so much better than 12 independent coin flips. If the passing grade were 7 correct answers, flipping 12 independent coins would have been better:

• Let $Y =$ no. of correct answers if you flip 12 independent coins.

• $P(Y = 6) = {12 \choose 6} ({1\over 2})^{12} \approx 0.2256.$

• By symmetry, $P(Y \ge 7) = {1 - P(Y = 6) \over 2} \approx 0.3872.$

• Meanwhile, of course $P(X \ge 7) = P(X \ge 8) \approx 0.2835$.

However, the passing grade is 8 correct answers, and you have invented a method which is guaranteed not to have 7 correct answers thereby eliminating the (useless-to-you) 7 correct answers situation.

---

Bonus: if the passing grade is 7 correct answers, then the correct strategy is to actually randomly answer 5 (or 7) of them as Yes!

• Let $Z =$ no. of correct answers if you randomly guess 5 Yes and 7 No. (Math is same if you guess 7 Yes and 5 No.)

• The only possible values are $Z \in \{1, 3, 5, 7, 9, 11\}$

• By symmetry, $P(Z \ge 7) = {1 \over 2} > P(Y \ge 7) \approx 0.3872 > P(X \ge 7 ) \approx 0.2835$.

I bet this observation generalizes: i.e., if the passing grade is odd, guess 5 (or 7) as Yes, and if the passing grade is even, guess 6 as Yes. What a way to game an exam!