MHB Markov Chain - Is state 2 periodic?

Click For Summary
The Markov chain defined by the given transition matrix is irreducible, as all states communicate with each other. State 2 is non-periodic because the probability of returning to it after any number of steps is greater than zero. Consequently, all states in the chain are also non-periodic. Additionally, since all states are aperiodic, the chain is considered ergodic. The discussion confirms the properties of the Markov chain regarding its irreducibility and ergodicity.
mathmari
Gold Member
MHB
Messages
4,984
Reaction score
7
Hey! :o

Given the Markov chain $\{X_n, n \geq 1\}$ and the following probability transition matrix:
$\begin{pmatrix}
0 & 1/3 & 2/3\\
1/4 & 3/4 & 0\\
2/5 & 0 & 3/5
\end{pmatrix}$

All states communicate, so the chain is irreducible, isn't?

Could you tell me if the state $2$ is periodic?
 
Physics news on Phys.org
mathmari said:
Hey! :o

Given the Markov chain $\{X_n, n \geq 1\}$ and the following probability transition matrix:
$\begin{pmatrix}
0 & 1/3 & 2/3\\
1/4 & 3/4 & 0\\
2/5 & 0 & 3/5
\end{pmatrix}$

All states communicate, so the chain is irreducible, isn't?

Could you tell me if the state $2$ is periodic?

Yes, the chain is irreducible!... the fact that $P_{2,2} \ne 0$ makes possible the return in the state 2 after any number of steps so that the state 2 is non periodic. In fact none of the states of the TM is periodic... Kind regards $\chi$ $\sigma$
 
chisigma said:
Yes, the chain is irreducible!... the fact that $P_{2,2} \ne 0$ makes possible the return in the state 2 after any number of steps so that the state 2 is non periodic. In fact none of the states of the TM is periodic... Kind regards $\chi$ $\sigma$

Ok! And is the chain ergodic?
 
mathmari said:
Ok! And is the chain ergodic?

The MC has all aperiodic states so that it is ergodic...

Kind regards

$\chi$ $\sigma$
 
chisigma said:
The MC has all aperiodic states so that it is ergodic...

Kind regards

$\chi$ $\sigma$

Ok! Thank you for your answer! :o
 
There is a nice little variation of the problem. The host says, after you have chosen the door, that you can change your guess, but to sweeten the deal, he says you can choose the two other doors, if you wish. This proposition is a no brainer, however before you are quick enough to accept it, the host opens one of the two doors and it is empty. In this version you really want to change your pick, but at the same time ask yourself is the host impartial and does that change anything. The host...

Similar threads

  • · Replies 1 ·
Replies
1
Views
2K
Replies
7
Views
2K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 4 ·
Replies
4
Views
5K
  • · Replies 5 ·
Replies
5
Views
1K
Replies
24
Views
4K
  • · Replies 13 ·
Replies
13
Views
3K
  • · Replies 12 ·
Replies
12
Views
17K