Dismiss Notice
Join Physics Forums Today!
The friendliest, high quality science and math community on the planet! Everyone who loves science is here!

Markov chain

  1. Feb 18, 2012 #1
    Hello all
    I have a question about Markov chain I've obtained in an application.
    There is no need to mention the application or the details of markov chain because my question is simply:

    The transition probabilities are derived with equations that depend on the stationary probability, I know it's something complicated ...

    The question is:
    1. do you know what is the class of these markov chains?
    2. how to solve it numerically, does it depend on Power method?

    If you have any paper or book it will be great
  2. jcsd
Share this great discussion with others via Reddit, Google+, Twitter, or Facebook

Can you offer guidance or do you also need help?