Question:
In a game with two people, there is a draw half of the time. The other half of the time, player A wins with 2/3 and player B wins with 1/3. The game ends once a player wins three games in a row. What is the probability A wins?
Approach:
I am thinking that this is somewhat similar to asking what is the probability of getting HHH before TTT. However, you need to compute the probability of each player winning in a round and not having a draw.
Let $P(A)$ probability A wins, let $P(B)$ be probability $B$ wins:
$$P(A) = \frac{1}{2}\frac{2}{3} = \frac{2}{6} \quad P(B) = \frac{1}{2}\frac{1}{3} = \frac{1}{6}$$
Let $E$ be the event that we get $AAA$ before $BBB$. However, I am not sure if we can use the below approach because I think we may violate the total law of probability. I am not sure how I can include a third draws? Do I add $P(\text{draw})P(E)$ to each of these? because if it is a draw, we restart...
$$P(E) = P(A)P(E|A_1) + P(B)P(E|B_1)$$
$$P(E|A_1) = P(A)P(E|A_1A_2) + P(B)P(E|A_1B_2) = P(A)P(E|A_1A_2) + P(B)P(E|B_1)$$
$$P(E|A_1A_2)= P(A)P(E|A_1A_2A_3) + P(B)P(E|A_1A_2B_3) = P(A) + P(B)P(E|B_1)$$
$$P(E|B_1) = P(A)P(E|B_1A_2) + P(B)P(E|B_1B_2) = P(A)P(E|A_1) + P(B)P(E|B_1B_2)$$
$$P(E|B_1B_2)= P(A)P(E|B_1B_2A_3) + P(B)P(E|B_1B_2B_3) = P(A)P(E|A_1) + 0$$
Substituting:
$$P(E|B_1) = P(A)P(E|A_1) + P(B)P(A)P(E|A_1)$$
$$P(E|A_1A_2)= P(A) + P(B)P(A)P(E|A_1) + P(B)P(B)P(A)P(E|A_1)$$
$$P(E|A_1) = P(A)P(A) + P(A)P(B)P(A)P(E|A_1) + P(A)P(B)P(B)P(A)P(E|A_1) + P(B)P(A)P(E|A_1) + P(B)P(B)P(A)P(E|A_1)$$ etc...
But this seems very messy ...
Note: I am assuming that draws kill the current winning streak. That is to say, if $A$ wins the first two games, draws the third, and then $A$ wins the fourth, $A$ is now just on a one game streak.
Proceed by states. Denote the current state of a game by $(X,n)$ Where $X\in \{A,B\}$ denotes the player currently on a winning streak and $n$ denotes the length of the winning streak. We let $\emptyset$ denote the starting state as well as any state in which the last round ended in a draw.
For a state $(X,n)$ we let $P_{X,n}$ denote the probability that $A$ will eventually win given that we are currently in that state.
We remark that \begin{align} P_{A,2} &= \frac 26\times 1+\frac 16\times P_{B,1}+\frac 12\times P_{\emptyset} \\ P_{A,1} &= \frac 26\times P_{A,2}+\frac 16\times P_{B,1}+\frac 12\times P_{\emptyset} \\ P_{B,2} &= \frac 26\times P_{A,1}+\frac 16\times 0+\frac 12\times P_{\emptyset} \\ P_{B,1} &= \frac 26\times P_{A,1}+\frac 16\times P_{B,2}+\frac 12\times P_{\emptyset} \\ P_{\emptyset} &= \frac 26\times P_{A,1}+\frac 16\times P_{B,1}+\frac 12\times P_{\emptyset} \end{align}
That gives us a solvable linear system. Barring arithmetic error, I get that $$\boxed{P_{\emptyset}=\frac {86}{99}}$$
here is the computation. There, $X=P_{A,2}, Y=P_{A,1}, Z=P_{B,2}, W=P_{B,1}, V=P_{\emptyset}$