MHB How Do You Calculate Long-Term Proportions in a Markov Chain?

Click For Summary
To calculate long-term proportions in a Markov chain with the transition matrix T = |0.7 0.4| |0.3 0.6|, the nth state can be determined using the formula s_n = T^n × s_0. For convergence, it's recommended to try n = 50 and n = 100; if the results stabilize, those values represent the long-term proportions. The initial state vector s_0 is crucial for this calculation; if it's not provided, testing scenarios like a = b = 0.5 can be useful. This approach allows for the determination of the long-term behavior of the states A and B. Understanding these calculations is essential for analyzing Markov chains effectively.
musad
Messages
8
Reaction score
0
Not really sure how to get started on this one:Find the long-term proportions, a and b, of the two states, A and B, corresponding to the transition matrix T=|0.7 0.4|
| 0.3 0.6|


Note, the matric is a 2x2 matrix

Thanks
 
Physics news on Phys.org
Consider the nth state of a,b to be given by $s_n = T^n \times s_0$

For long term convergence try n = 50 and n=100, if they do not vary then you have your answer.

The only bit we are missing is $s_0$ were you given that? If not try some scenarios i.e. $a=b=0.5$
 
Greetings, I am studying probability theory [non-measure theory] from a textbook. I stumbled to the topic stating that Cauchy Distribution has no moments. It was not proved, and I tried working it via direct calculation of the improper integral of E[X^n] for the case n=1. Anyhow, I wanted to generalize this without success. I stumbled upon this thread here: https://www.physicsforums.com/threads/how-to-prove-the-cauchy-distribution-has-no-moments.992416/ I really enjoyed the proof...

Similar threads

  • · Replies 6 ·
Replies
6
Views
2K
Replies
24
Views
4K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 20 ·
Replies
20
Views
5K
  • · Replies 11 ·
Replies
11
Views
2K
Replies
1
Views
2K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 18 ·
Replies
18
Views
3K
Replies
1
Views
6K
  • · Replies 0 ·
Replies
0
Views
3K