My proof: For all possible events, based on the order of appearance between 5 and 6.l, they can be categorised into 2 groups.
$A:$ event with 5 appear before 6
$A^{c}:$ event with 6 appear before 5
And the union of $A$ and $A^{c}$ should be all possible events.
So $P(A) + P(A^{c}) = 1$
The last step: by symmetry, number of events that have 5 before 6 is the same as that for 6 before 5.
So $P(A) = P(A^{c}) = 0.5$
However, this last step I am not sure how to write out a formal proof to support my intuition for the symmetry. I think I need to evaluate the cardinality $A$ and $A^{c}$ but not sure how to. So I need help here.
to summarize the discussion in the comments:
For each $n\in \mathbb N$, let $p_n$ denote the probability that you see a $5$ before a $6$ in no more than $n$ tosses. Of course, by symmetry, $p_n$ is also the probability that you see $6$ before $5$ within $n$ tosses. These won't add to $1$, indeed, $1-2p_n$ is the probability you see neither $5$ nor $6$ in $n$ tosses. Thus $$1-2p_n=\left( \frac 46\right)^n\implies p_n=\frac 12-\frac 12\times \left( \frac 46\right)^n$$
Letting $n$ tend to $\infty$ then yields the desired result.