What is the Power Spectrum of a Markov Chain?

  • Context: Graduate 
  • Thread starter Thread starter seang
  • Start date Start date
  • Tags Tags
    Chain Markov chain
Click For Summary

Discussion Overview

The discussion revolves around understanding the concept of Markov chains, particularly in relation to their power spectrum and applications in modeling learning processes. Participants explore definitions, mathematical representations, and specific calculations related to Markov chains.

Discussion Character

  • Exploratory, Technical explanation, Conceptual clarification, Homework-related

Main Points Raised

  • One participant expresses confusion about the concept of Markov chains and their application in psychology, particularly in modeling learning.
  • Another participant suggests looking at sequence of state probability matrices as a resource for understanding Markov chains.
  • A third participant defines a Markov chain as a sequence of random variables where the distribution of a given state depends only on the immediately preceding state.
  • A different participant seeks assistance in finding the power spectrum of a Markov chain, specifically mentioning the Fourier transform of its autocorrelation.

Areas of Agreement / Disagreement

Participants do not appear to reach a consensus on the understanding of Markov chains, as there are varying levels of familiarity and different aspects being discussed. The discussion remains unresolved regarding the specific calculations related to the power spectrum.

Contextual Notes

Some limitations include the lack of detailed mathematical steps for calculating the power spectrum and the varying definitions of Markov chains that may depend on context.

Who May Find This Useful

This discussion may be useful for individuals interested in the mathematical modeling of processes, particularly in psychology and statistics, as well as those looking to understand the technical aspects of Markov chains and their applications.

seang
Messages
184
Reaction score
0
I'm reading the wikipedia article on them and I can't really get an understanding of what they are.

I'm writing a paper for psychology, and I keep coming across articles that say 'learning can be modeled with markov chains'

what does that mean?
 
Mathematics news on Phys.org
sequence of state probability matrices...mathworld.com is your friend.
 
A Markov chain is a sequence of random variables where the distribution of a given state depends on the immediately preceding state, but not on what happened before then.
 
hi there
I'm trying to find the power spectrum of a markov chain which is the Fourier transform of it's autocorrelation. I'm having trouble with this if anyone can help me out I would appreciate it.
thanks
 

Similar threads

Replies
24
Views
4K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 2 ·
Replies
2
Views
3K
Replies
9
Views
3K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 1 ·
Replies
1
Views
3K
  • · Replies 12 ·
Replies
12
Views
2K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 2 ·
Replies
2
Views
4K
  • · Replies 42 ·
2
Replies
42
Views
6K