MHB How Do You Calculate Long-Term Proportions in a Markov Chain?

Click For Summary
To calculate long-term proportions in a Markov chain with the transition matrix T = |0.7 0.4| |0.3 0.6|, the nth state can be determined using the formula s_n = T^n × s_0. For convergence, it's recommended to try n = 50 and n = 100; if the results stabilize, those values represent the long-term proportions. The initial state vector s_0 is crucial for this calculation; if it's not provided, testing scenarios like a = b = 0.5 can be useful. This approach allows for the determination of the long-term behavior of the states A and B. Understanding these calculations is essential for analyzing Markov chains effectively.
musad
Messages
8
Reaction score
0
Not really sure how to get started on this one:Find the long-term proportions, a and b, of the two states, A and B, corresponding to the transition matrix T=|0.7 0.4|
| 0.3 0.6|


Note, the matric is a 2x2 matrix

Thanks
 
Physics news on Phys.org
Consider the nth state of a,b to be given by $s_n = T^n \times s_0$

For long term convergence try n = 50 and n=100, if they do not vary then you have your answer.

The only bit we are missing is $s_0$ were you given that? If not try some scenarios i.e. $a=b=0.5$
 
There is a nice little variation of the problem. The host says, after you have chosen the door, that you can change your guess, but to sweeten the deal, he says you can choose the two other doors, if you wish. This proposition is a no brainer, however before you are quick enough to accept it, the host opens one of the two doors and it is empty. In this version you really want to change your pick, but at the same time ask yourself is the host impartial and does that change anything. The host...

Similar threads

  • · Replies 6 ·
Replies
6
Views
2K
Replies
24
Views
4K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 20 ·
Replies
20
Views
5K
  • · Replies 11 ·
Replies
11
Views
2K
Replies
1
Views
2K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 18 ·
Replies
18
Views
3K
Replies
1
Views
6K
  • · Replies 0 ·
Replies
0
Views
3K