Markov Chain of Stochastic Processes

Join the discussion
Ask a follow-up here, or get your own question answered by working scientists, mathematicians and engineers — people, not an autocomplete.
Real named experts · corrections over time · the nuance an AI answer skips
2 replies · 2K views
stargazer_iq
Messages
6
Reaction score
0
I would like to construct a model using a markov chain that has different stochastic processes for each state in the chain. Is there a term for such a thing, or anything similar to it?
Thanks
 
Physics news on Phys.org
i found something similar to what I'm looking for in this paper:
HS Chang, "Multitime Scale Markov Decision Processes", 2003