1. Limited time only! Sign up for a free 30min personal tutor trial with Chegg Tutors
    Dismiss Notice
Dismiss Notice
Join Physics Forums Today!
The friendliest, high quality science and math community on the planet! Everyone who loves science is here!

What's a Markov Chain?

  1. Mar 31, 2007 #1
    I'm reading the wikipedia article on them and I can't really get an understanding of what they are.

    I'm writing a paper for psychology, and I keep coming across articles that say 'learning can be modeled with markov chains'

    what does that mean?
  2. jcsd
  3. Mar 31, 2007 #2
    sequence of state probability matrices....mathworld.com is your friend.
  4. Mar 31, 2007 #3


    User Avatar
    Science Advisor

    A Markov chain is a sequence of random variables where the distribution of a given state depends on the immediately preceding state, but not on what happened before then.
  5. Sep 19, 2007 #4
    hi there
    I'm trying to find the power spectrum of a markov chain which is the fourier transform of it's autocorrelation. I'm having trouble with this if anyone can help me out I would appreciate it.
Share this great discussion with others via Reddit, Google+, Twitter, or Facebook