Dismiss Notice
Join Physics Forums Today!
The friendliest, high quality science and math community on the planet! Everyone who loves science is here!

What's a Markov Chain?

  1. Mar 31, 2007 #1
    I'm reading the wikipedia article on them and I can't really get an understanding of what they are.

    I'm writing a paper for psychology, and I keep coming across articles that say 'learning can be modeled with markov chains'

    what does that mean?
  2. jcsd
  3. Mar 31, 2007 #2
    sequence of state probability matrices....mathworld.com is your friend.
  4. Mar 31, 2007 #3


    User Avatar
    Science Advisor
    Gold Member

    A Markov chain is a sequence of random variables where the distribution of a given state depends on the immediately preceding state, but not on what happened before then.
  5. Sep 19, 2007 #4
    hi there
    I'm trying to find the power spectrum of a markov chain which is the fourier transform of it's autocorrelation. I'm having trouble with this if anyone can help me out I would appreciate it.
Know someone interested in this topic? Share this thread via Reddit, Google+, Twitter, or Facebook

Have something to add?

Similar Discussions: What's a Markov Chain?
  1. Chain Rule (Replies: 65)

  2. Markov chain (Replies: 0)