Aperiodicity of a Markov Chain

Click For Summary
SUMMARY

The discussion centers on the aperiodicity of a specific Markov chain represented by the transition matrix: 0 0 1, 0 0 1, (1/3) (2/3) 0. Participants clarify that a Markov chain is aperiodic if there exists a time n such that there is a non-zero probability of transitioning between any two states for all i and j. The chain in question is confirmed to be aperiodic, as it allows transitions between all states over multiple steps, despite initial confusion regarding the definition of aperiodicity.

PREREQUISITES
  • Understanding of Markov chains and their properties
  • Familiarity with transition matrices
  • Knowledge of probability theory
  • Ability to analyze state transitions
NEXT STEPS
  • Study the concept of aperiodicity in Markov chains
  • Learn about transition matrices and their implications in state transitions
  • Explore examples of periodic vs. aperiodic Markov chains
  • Investigate the implications of aperiodicity on long-term behavior of Markov chains
USEFUL FOR

Students and researchers in mathematics, particularly those studying stochastic processes, Markov chains, and probability theory.

.....
Messages
53
Reaction score
0

Homework Statement



Transition matrix is

0 0 1
0 0 1
(1/3) (2/3) 0

"argue that this chain is aperiodic"


Homework Equations



definition of aperiodicity - there must exist a time n such that there is a non-zero probability of going from state i to state j for all i & j

The Attempt at a Solution



This definition doesn't seem to hold for my chain ... for example, to go from state 1 to state 2 n has to be odd.. but to go from state 1 to state 1 or 3 n has to be even..

Am I just getting this definition muddled up? Could someone elaborate on it for me? Thanks
 
Physics news on Phys.org
anyone?
 
The chain is aperiodic 1->3->2->3->1
You can get from any position to any other (it doesn't have to be in one step..)
 
Yeah, I can see it's not periodic and hence must be apeiodic, but what's going on with that definition? My understanding of it is that there has to be a special (fixed) value of n where you can go from anyone state to all the others, including back to that state... but that doesn't seem to hold here... thanks for replying
 

Similar threads

  • · Replies 6 ·
Replies
6
Views
2K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 5 ·
Replies
5
Views
3K
Replies
9
Views
2K
  • · Replies 29 ·
Replies
29
Views
2K
  • · Replies 12 ·
Replies
12
Views
2K
Replies
0
Views
892
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K