Hi all,(adsbygoogle = window.adsbygoogle || []).push({});

Im currently researching into stochastic proesses. The gaussian process wasnt hard to tackle, However, I dont understand the Markov process. See I understand that a stochastic process is a family of random variable's which is dependent and distinguished upon another variable. But with a Markov process I cant see where this family of random variables like the way I see it in the Gaussian process. How could I understand this graphically?

I also realise that we need to sets of information, is it the initial distribution or the initial point and the transition probability?

Another thing I dont understand is if these stochastic processes are related to time how are we suppose to know the distribution at a particular point in time if only one thing can occur at a particular point in time?

Please help,

Regards

Steven

**Physics Forums - The Fusion of Science and Community**

The friendliest, high quality science and math community on the planet! Everyone who loves science is here!

# Markov process

Loading...

Similar Threads - Markov process | Date |
---|---|

I A seemingly simple problem about probability | Jan 29, 2018 |

I Probability of a Stochastic Markov process | Dec 27, 2017 |

A Probability amplitude | May 7, 2017 |

Gauss-Markov process covariance function | Oct 29, 2015 |

When are Markov processes non-reversible? | Feb 23, 2014 |

**Physics Forums - The Fusion of Science and Community**