I want to describe this case in markov chain:
The case:
Mr. Meier reads NYTimes everyday and puts the newspaper on news rack. His wife sometimes cleans the house(with prob $1/3$ each day) and throws away all newspapers. If there are 5 or more newspapers on the rack, Mr. Meier throws away them by his own hand.
Now lets assume, husband and wife are gone to bed. How can i describe the number of newspapers on the news rack with markov chain?
I am kinda stuck, what are the my state spaces here?