MHB Markov Chain - Is state 2 periodic?

Click For Summary
The Markov chain defined by the given transition matrix is irreducible, as all states communicate with each other. State 2 is non-periodic because the probability of returning to it after any number of steps is greater than zero. Consequently, all states in the chain are also non-periodic. Additionally, since all states are aperiodic, the chain is considered ergodic. The discussion confirms the properties of the Markov chain regarding its irreducibility and ergodicity.
mathmari
Gold Member
MHB
Messages
4,984
Reaction score
7
Hey! :o

Given the Markov chain $\{X_n, n \geq 1\}$ and the following probability transition matrix:
$\begin{pmatrix}
0 & 1/3 & 2/3\\
1/4 & 3/4 & 0\\
2/5 & 0 & 3/5
\end{pmatrix}$

All states communicate, so the chain is irreducible, isn't?

Could you tell me if the state $2$ is periodic?
 
Physics news on Phys.org
mathmari said:
Hey! :o

Given the Markov chain $\{X_n, n \geq 1\}$ and the following probability transition matrix:
$\begin{pmatrix}
0 & 1/3 & 2/3\\
1/4 & 3/4 & 0\\
2/5 & 0 & 3/5
\end{pmatrix}$

All states communicate, so the chain is irreducible, isn't?

Could you tell me if the state $2$ is periodic?

Yes, the chain is irreducible!... the fact that $P_{2,2} \ne 0$ makes possible the return in the state 2 after any number of steps so that the state 2 is non periodic. In fact none of the states of the TM is periodic... Kind regards $\chi$ $\sigma$
 
chisigma said:
Yes, the chain is irreducible!... the fact that $P_{2,2} \ne 0$ makes possible the return in the state 2 after any number of steps so that the state 2 is non periodic. In fact none of the states of the TM is periodic... Kind regards $\chi$ $\sigma$

Ok! And is the chain ergodic?
 
mathmari said:
Ok! And is the chain ergodic?

The MC has all aperiodic states so that it is ergodic...

Kind regards

$\chi$ $\sigma$
 
chisigma said:
The MC has all aperiodic states so that it is ergodic...

Kind regards

$\chi$ $\sigma$

Ok! Thank you for your answer! :o
 
First trick I learned this one a long time ago and have used it to entertain and amuse young kids. Ask your friend to write down a three-digit number without showing it to you. Then ask him or her to rearrange the digits to form a new three-digit number. After that, write whichever is the larger number above the other number, and then subtract the smaller from the larger, making sure that you don't see any of the numbers. Then ask the young "victim" to tell you any two of the digits of the...

Similar threads

  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 7 ·
Replies
7
Views
2K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 4 ·
Replies
4
Views
5K
  • · Replies 5 ·
Replies
5
Views
1K
Replies
24
Views
4K
  • · Replies 13 ·
Replies
13
Views
3K
  • · Replies 12 ·
Replies
12
Views
17K