Markov Process Expectation and Variance

90 Views Asked by At

Consider Markov process, where a person is searching for some particular piece of information among the list of all kinds of data. The first time the person studies some new piece of information, the probability that it satisfies the person is A. If this piece satisfies the person, then the person ceases his search. Otherwise, the person continues. The probability that the person is satisfied by the second result is also A and so on. For simplicity, we may assume that there is an infinite list of pieces of information, so theoretically, the person may never reach the end. The questions asks to calculate expectation of the number of results the person studies and its variance.

I have started solving the problem, but all I can think about is that it is just a Geometric distribution. I do not really see where I can use the property of the Markov process. I understand that maybe the pieces of information are not independent, but I don’t see how can I apply this to the problem to get any meaningful result.