a random walker, walks on a lattice with non-negative coordinates. In each step, if he is in a positive coordinate, say $(a,b)$ where $a,b>0$ he will go to $(a-1,b)$ or $(a,b-1)$ with same probability ($p=\frac12$) and whenever he reaches to $x$ or $y$ axes he will stop. Assume that this random walker starts walking from the point $(k,k)$: What is the probability that he reaches to any of axes? What is the expected value of number of steps before stopping? And what is the expected value of sum of components of coordinate of stopping point?
My effort is trying to solve this question with markov chain approach. I define $e_1=(-1,0)$ and $e_2=(0,-1)$ and also I use $S_n$ for denoting random walker's coordinate in $n^{th}$ step, hence we have $S_n=x+X_1+X_2+\dots+X_n$ where $x$ denotes the start point and for every $1<i<n$ we have $X_i \in \{e_1,e_2\} $. So, for any point like $z,y$ we have $\mathbb{P}(S_{n+1}=z \ | S_n=y)=\frac12$. But as this random walk is not symmetric I can't go further!
This is a slightly modified version of Banach's matchbox problem where you stop as soon as one box becomes empty, rather than when you first choose an empty box.
Let $N$ be the number of steps needed, and $R$ the sum of the coordinates of the final position. Since this sum is reduced by 1 at every step, we have $N+R=2k$, so that if you solve the second problem, you immediately get the answer for the third problem for free.
It is not hard to show that, for $1\leq r\leq k$, we have $$\mathbb{P}(R=r)={2k-r-1\choose k-1}\left({1\over 2}\right)^{2k-r-1},$$ so that $\mathbb{E}(R)=\sum_{r=1}^k r{2k-r-1\choose k-1}\left({1\over 2}\right)^{2k-r-1}=2k\,{2k\choose k}/4^k,$ and hence $\mathbb{E}(N)=2k\left\{1-{2k\choose k}/4^k\right\}.$