What's a Markov Chain?

  • Thread starter seang
  • Start date
  • #1
184
0

Main Question or Discussion Point

I'm reading the wikipedia article on them and I can't really get an understanding of what they are.

I'm writing a paper for psychology, and I keep coming across articles that say 'learning can be modeled with markov chains'

what does that mean?
 

Answers and Replies

  • #2
1,356
2
sequence of state probability matrices....mathworld.com is your friend.
 
  • #3
mathman
Science Advisor
7,766
417
A Markov chain is a sequence of random variables where the distribution of a given state depends on the immediately preceding state, but not on what happened before then.
 
  • #4
hi there
I'm trying to find the power spectrum of a markov chain which is the fourier transform of it's autocorrelation. I'm having trouble with this if anyone can help me out I would appreciate it.
thanks
 

Related Threads on What's a Markov Chain?

  • Last Post
Replies
1
Views
2K
  • Last Post
Replies
2
Views
1K
Replies
3
Views
8K
Replies
2
Views
1K
  • Last Post
Replies
1
Views
1K
  • Last Post
Replies
1
Views
2K
  • Last Post
Replies
4
Views
8K
  • Last Post
3
Replies
65
Views
8K
  • Last Post
Replies
6
Views
2K
Replies
1
Views
2K
Top