Proving property of Markov chains.

125 Views Asked by At

There is a proof of the following Markov-chain I don't understand. I have circled in red the two steps I do not understand. Could you please explain the steps for me? enter image description here

In the proof they also refer to equation 2.4, this is given below here:

enter image description here