Dismiss Notice
Join Physics Forums Today!
The friendliest, high quality science and math community on the planet! Everyone who loves science is here!

Homework Help: State in a Markov chain is persistent if there are an infinite number of visits to it

  1. Jun 27, 2011 #1
    In a Markov chain, show that a state i is persistent if and only if the mean number of visits to the state i is infinite given the chain started in state i.

    I thought about looking at the mean recurrence time, but that's all I have so far.
     
  2. jcsd
  3. Jun 27, 2011 #2

    lanedance

    User Avatar
    Homework Helper

    Re: State in a Markov chain is persistent if there are an infinite number of visits t

    start with the definition of persistent
     
Share this great discussion with others via Reddit, Google+, Twitter, or Facebook