Register to reply

Markov chain

by giglamesh
Tags: chain, markov
Share this thread:
giglamesh
#1
Feb18-12, 06:53 PM
P: 14
Hello all
I have a question about Markov chain I've obtained in an application.
There is no need to mention the application or the details of markov chain because my question is simply:

The transition probabilities are derived with equations that depend on the stationary probability, I know it's something complicated ...

The question is:
1. do you know what is the class of these markov chains?
2. how to solve it numerically, does it depend on Power method?

If you have any paper or book it will be great
Thanks
Phys.Org News Partner Mathematics news on Phys.org
Heat distributions help researchers to understand curved space
Professor quantifies how 'one thing leads to another'
Team announces construction of a formal computer-verified proof of the Kepler conjecture

Register to reply

Related Discussions
Markov Chain Calculus & Beyond Homework 1
Rat and Cat Markov Chain Calculus & Beyond Homework 1
Markov chain Calculus & Beyond Homework 0
What's a Markov Chain? General Math 3
Markov chain Set Theory, Logic, Probability, Statistics 1