Markov Chain of Stochastic Processes

Join the discussion
Registration is free. Ask a follow-up in this thread, or start your own.
2 replies · 2K views
stargazer_iq
Messages
6
Reaction score
0
I would like to construct a model using a markov chain that has different stochastic processes for each state in the chain. Is there a term for such a thing, or anything similar to it?
Thanks
 
Physics news on Phys.org
i found something similar to what I'm looking for in this paper:
HS Chang, "Multitime Scale Markov Decision Processes", 2003