Persistence of State i in a Markov Chain

[xentity1x]

In a Markov chain, show that a state i is persistent if and only if the mean number of visits to the state i is infinite given the chain started in state i.

I thought about looking at the mean recurrence time, but that's all I have so far.

 

[lanedance]

start with the definition of persistent