What is the Power Spectrum of a Markov Chain?

AI Thread Summary
The discussion focuses on understanding the power spectrum of a Markov chain, particularly its relation to learning models in psychology. A Markov chain consists of a sequence of random variables where the current state depends only on the previous state. The power spectrum is defined as the Fourier transform of the autocorrelation of the Markov chain. Participants express difficulty in grasping these concepts and seek assistance in calculating the power spectrum. Clarifying these mathematical relationships is essential for applying Markov chains in psychological research.
seang
Messages
184
Reaction score
0
I'm reading the wikipedia article on them and I can't really get an understanding of what they are.

I'm writing a paper for psychology, and I keep coming across articles that say 'learning can be modeled with markov chains'

what does that mean?
 
Mathematics news on Phys.org
sequence of state probability matrices...mathworld.com is your friend.
 
A Markov chain is a sequence of random variables where the distribution of a given state depends on the immediately preceding state, but not on what happened before then.
 
hi there
I'm trying to find the power spectrum of a markov chain which is the Fourier transform of it's autocorrelation. I'm having trouble with this if anyone can help me out I would appreciate it.
thanks
 

Thread 'What Exactly is Dirac’s Delta Function? - Insight'

Insights auto threads is broken atm, so I'm manually creating these for new Insight articles. In Dirac’s Principles of Quantum Mechanics published in 1930 he introduced a “convenient notation” he referred to as a “delta function” which he treated as a continuum analog to the discrete Kronecker delta. The Kronecker delta is simply the indexed components of the identity operator in matrix algebra Source: https://www.physicsforums.com/insights/what-exactly-is-diracs-delta-function/ by...
View full post »

Thread 'Non-orthogonal bases'

Suppose ,instead of the usual x,y coordinate system with an I basis vector along the x -axis and a corresponding j basis vector along the y-axis we instead have a different pair of basis vectors ,call them e and f along their respective axes. I have seen that this is an important subject in maths My question is what physical applications does such a model apply to? I am asking here because I have devoted quite a lot of time in the past to understanding convectors and the dual...
View full post »
Thread 'Imaginary Pythagoras'

Thread 'Imaginary Pythagoras'

I posted this in the Lame Math thread, but it's got me thinking. Is there any validity to this? Or is it really just a mathematical trick? Naively, I see that i2 + plus 12 does equal zero2. But does this have a meaning? I know one can treat the imaginary number line as just another axis like the reals, but does that mean this does represent a triangle in the complex plane with a hypotenuse of length zero? Ibix offered a rendering of the diagram using what I assume is matrix* notation...
View full post »

Similar threads

Understanding Markov Chains: Deriving and Solving Probabilities
Replies
1
Views
2K
The infinite limits of the probability transition matrix for Markov chain
Replies
24
Views
4K
Math Modeling with markov chains
Replies
2
Views
2K
MHB Optimizing Markov Chain Production System Throughput w/ Exponential Rate of 50
Replies
1
Views
2K
A Martingale, calculation of probability - Markov chain needed?
Replies
3
Views
2K
Morin's mechanics problem 2.3 (motionless chain)
Replies
2
Views
2K
Concept question on irreducibility (markov chain)
Replies
1
Views
2K
What is the proportion of time the runner runs barefooted using a Markov Chain?
Replies
9
Views
2K
Can any one clear me the concept of hidden markov model?
Replies
2
Views
2K
B How can we accurately model data using curve fitting techniques?
Replies
4
Views
2K

Hot Threads

Recent Insights

Back
Top