Any fast way to compute the fixed vector of a Markov chain transistion matrix?

Click For Summary
SUMMARY

The discussion centers on computing the fixed vector of a Markov chain transition matrix using linear algebra techniques. The user currently employs the method of solving the equation (M-I)w=0, where M is the transition matrix, and w is the fixed vector. They seek a faster method to compute the eigenvector corresponding to the eigenvalue λ=1. The conversation highlights the need for more efficient algorithms in linear algebra to expedite this process.

PREREQUISITES
  • Understanding of Markov chains and transition matrices
  • Familiarity with eigenvalues and eigenvectors
  • Knowledge of linear algebra concepts, particularly solving linear equations
  • Experience with computational tools for matrix operations
NEXT STEPS
  • Research algorithms for computing eigenvectors, such as the Power Iteration method
  • Explore the use of NumPy for efficient matrix operations in Python
  • Learn about the QR algorithm for eigenvalue problems
  • Investigate the application of iterative methods for large sparse matrices
USEFUL FOR

Mathematicians, data scientists, and anyone involved in computational linear algebra or Markov chain analysis will benefit from this discussion.

samuelandjw
Messages
22
Reaction score
0
* I have already posted this in the General Math, but I guess the problem is more like a linear algebra problem.

Currently I am using a rather simple way, to solve vector w from (M-I)w=0 (replace one equation by w1+w2+...wn=1). Is there any faster way to do this? Thank you.
 
Physics news on Phys.org
I would calculate the Transition matrix's eigenvector corresponding to \lambda=1.
 
SprucerMoose said:
I would calculate the Transition matrix's eigenvector corresponding to \lambda=1.

basically the same as mine.
 

Similar threads

  • · Replies 2 ·
Replies
2
Views
1K
  • · Replies 4 ·
Replies
4
Views
4K
  • · Replies 1 ·
Replies
1
Views
3K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 8 ·
Replies
8
Views
4K
  • · Replies 1 ·
Replies
1
Views
5K
Replies
1
Views
7K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 11 ·
Replies
11
Views
3K
  • · Replies 69 ·
3
Replies
69
Views
9K