MHB Markov Chain - Is state 2 periodic?

mathmari
Gold Member
MHB
Messages
4,984
Reaction score
7
Hey! :o

Given the Markov chain $\{X_n, n \geq 1\}$ and the following probability transition matrix:
$\begin{pmatrix}
0 & 1/3 & 2/3\\
1/4 & 3/4 & 0\\
2/5 & 0 & 3/5
\end{pmatrix}$

All states communicate, so the chain is irreducible, isn't?

Could you tell me if the state $2$ is periodic?
 
Physics news on Phys.org
mathmari said:
Hey! :o

Given the Markov chain $\{X_n, n \geq 1\}$ and the following probability transition matrix:
$\begin{pmatrix}
0 & 1/3 & 2/3\\
1/4 & 3/4 & 0\\
2/5 & 0 & 3/5
\end{pmatrix}$

All states communicate, so the chain is irreducible, isn't?

Could you tell me if the state $2$ is periodic?

Yes, the chain is irreducible!... the fact that $P_{2,2} \ne 0$ makes possible the return in the state 2 after any number of steps so that the state 2 is non periodic. In fact none of the states of the TM is periodic... Kind regards $\chi$ $\sigma$
 
chisigma said:
Yes, the chain is irreducible!... the fact that $P_{2,2} \ne 0$ makes possible the return in the state 2 after any number of steps so that the state 2 is non periodic. In fact none of the states of the TM is periodic... Kind regards $\chi$ $\sigma$

Ok! And is the chain ergodic?
 
mathmari said:
Ok! And is the chain ergodic?

The MC has all aperiodic states so that it is ergodic...

Kind regards

$\chi$ $\sigma$
 
chisigma said:
The MC has all aperiodic states so that it is ergodic...

Kind regards

$\chi$ $\sigma$

Ok! Thank you for your answer! :o
 
Namaste & G'day Postulate: A strongly-knit team wins on average over a less knit one Fundamentals: - Two teams face off with 4 players each - A polo team consists of players that each have assigned to them a measure of their ability (called a "Handicap" - 10 is highest, -2 lowest) I attempted to measure close-knitness of a team in terms of standard deviation (SD) of handicaps of the players. Failure: It turns out that, more often than, a team with a higher SD wins. In my language, that...
Hi all, I've been a roulette player for more than 10 years (although I took time off here and there) and it's only now that I'm trying to understand the physics of the game. Basically my strategy in roulette is to divide the wheel roughly into two halves (let's call them A and B). My theory is that in roulette there will invariably be variance. In other words, if A comes up 5 times in a row, B will be due to come up soon. However I have been proven wrong many times, and I have seen some...

Similar threads

Back
Top