Register to reply

Markov chain

by giglamesh
Tags: chain, markov
Share this thread:
giglamesh
#1
Feb18-12, 06:53 PM
P: 14
Hello all
I have a question about Markov chain I've obtained in an application.
There is no need to mention the application or the details of markov chain because my question is simply:

The transition probabilities are derived with equations that depend on the stationary probability, I know it's something complicated ...

The question is:
1. do you know what is the class of these markov chains?
2. how to solve it numerically, does it depend on Power method?

If you have any paper or book it will be great
Thanks
Phys.Org News Partner Mathematics news on Phys.org
Math journal puts Rauzy fractcal image on the cover
Heat distributions help researchers to understand curved space
Professor quantifies how 'one thing leads to another'

Register to reply

Related Discussions
Markov Chain Calculus & Beyond Homework 1
Rat and Cat Markov Chain Calculus & Beyond Homework 1
Markov chain Calculus & Beyond Homework 0
What's a Markov Chain? General Math 3
Markov chain Set Theory, Logic, Probability, Statistics 1