Dismiss Notice
Join Physics Forums Today!
The friendliest, high quality science and math community on the planet! Everyone who loves science is here!

Markov Chain of Stochastic Processes

  1. Oct 7, 2009 #1
    I would like to construct a model using a markov chain that has different stochastic processes for each state in the chain. Is there a term for such a thing, or anything similar to it?
  2. jcsd
  3. Oct 7, 2009 #2


    User Avatar
    Science Advisor
    Homework Helper

  4. Oct 8, 2009 #3
    i found something similar to what I'm looking for in this paper:
    HS Chang, "Multitime Scale Markov Decision Processes", 2003
Know someone interested in this topic? Share this thread via Reddit, Google+, Twitter, or Facebook

Similar Discussions: Markov Chain of Stochastic Processes
  1. Markov chains (Replies: 17)

  2. Markov Chains (Replies: 6)

  3. Markov chains (Replies: 10)