Proof of aperiodic Markov Convergence Theorem for null recurrent case.

508 Views Asked by At

Status quo:
We consider a irreducible, aperiodic Markov chain $(X_n)_{n\in\mathbb{N}}$ on a countable set $S$ with tranistion function $p(\cdot,\cdot)$.

Now we want to examine $\underset{n\rightarrow\infty}{\text{lim}}~p^n(i,j)$ for arbitrary $i,j\in S$.

If $j$ is transient we can show that $\sum_{n=0}^\infty p^n(i,j)<\infty$ and therefore we know that $\underset{n\rightarrow\infty}{\text{lim}}~p^n(i,j)=0$. If $j$ is positive recurrent we can show by nice coupling argument (see for example Durrett) that $\underset{n\rightarrow\infty}{\text{lim}}~p^n(i,j)=\pi(j)$, where $\pi$ is the unique stationary distribution of the chain.

The question:
My concern is the null recurrent case. I looked through a bunch of textbooks and I could not find a proof for the fact that $\underset{n\rightarrow\infty}{\text{lim}}~p^n(i,j)=0$ in this case. Most textbooks mention it but none of them gives a proof and I can't proof it either.
Any ideas, thoughts and especially references are highly appreciated. Thanks!

1

There are 1 best solutions below

0
On BEST ANSWER

After some more research I found a nice answer in the book by Norris Theorem 1.8.5. It also makes use of a Coupling argument with the choice of a shifted measure.