Positive recurrent CTMC with a null recurrent embedded DTMC

  • Context: Graduate 
  • Thread starter Thread starter Doobious
  • Start date Start date
  • Tags Tags
    Positive
Join the discussion
Registration is free. Ask a follow-up in this thread, or start your own.
1 reply · 3K views
Doobious
Messages
1
Reaction score
0
A continuous-time markov chain is recurrent if and only if the embedded discrete time markov chain is recurrent. But, (as stated in several sources without proof or example that I can find) if the CTMC is positive recurrent the DTMC may be null recurrent and vice versa. Can someone provide an example where this occurs?

Thanks.
 
Physics news on Phys.org
Depends what "the" embedded DTMC means, but wouldn't the expected return time for the CTMC be less than for the DTMC?
 
Last edited: