Simple example of a Markov chain

nktvnvn · Apr 24, 2005

Hi all

Does anyone in this forum have a firm understanding of Markov Chains? I searched for this thing on the Net but could not find very useful information. Most of them are very abstract.

I appreciate it if anyone can please show me an easy-to-follow example to illustrate the purpose of Markov Chains.

Thanks a lot.

PerennialII · Apr 25, 2005

This is pretty straightforward, see the links for more info :

http://en.wikipedia.org/wiki/Markov_chains

neurocomp2003 · Apr 25, 2005

mathworld.com

Simple example of a Markov chain

Discussion

Similar threads

Why does the summation in Markov chain inner product use g(i) instead of g(j)?

The infinite limits of the probability transition matrix for Markov chain

"Two step" Markov chain is also a Markov chain.

Graduate How can I compute expected return time of a state in a Markov Chain?

Graduate Martingale, calculation of probability - Markov chain needed?

Regarding mixing time of a Markov chain

Graduate Coin flipping problem (Markov chain)

A discrete-time queue Markov Chain problem

Undergrad Proving P(X_4|X_1,X_2)=P(X_4|X_2) for Markov Chain with Finite Possibilities

Graduate Finding a closed form for f(n)ij in a Markov chain