Dismiss Notice
Join Physics Forums Today!
The friendliest, high quality science and math community on the planet! Everyone who loves science is here!

Dynamic transition probability matrix in markov chains

  1. Jul 22, 2011 #1
    I am intrigued by the idea of changing/dynamic transition probability matrix instead of the assumption of constant transition probability between states.

    For eg. Probability of population migrating between 2 states might not remain constant and can be a function of its population or some other factors. Is there a systematic study of this particular category of dynamic or changing transition probabilities in markov processes.
  2. jcsd
  3. Jul 22, 2011 #2

    Stephen Tashi

    User Avatar
    Science Advisor

    You're interested in a topic called "non-homogeneous Markov chains" or "time non-homogeneous Markov chains".

    I don't know a good reference that introduces this topic and I don't claim to be able to introduce it myself!
Share this great discussion with others via Reddit, Google+, Twitter, or Facebook