When are Markov Matrices also Martingales?

  • Context: Undergrad 
  • Thread starter Thread starter WWGD
  • Start date Start date
Click For Summary
SUMMARY

Markov Chains can exhibit Martingale properties under specific conditions, particularly when dealing with symmetric random walks where the probability p equals 0.5. The discussion highlights that risk-neutral probabilities are martingales, although they do not necessarily equal 0.5. Additionally, the conversation touches on income decile transition matrices and their stabilization behavior, suggesting that the dominant eigenvalues of the Markov matrix M approach the kth root of unity. The correctness of the formula M^k = n^(k-1) * c^k * J, where J is a constant matrix, is affirmed.

PREREQUISITES
  • Understanding of Markov Chains and their properties
  • Knowledge of Martingales in probability theory
  • Familiarity with eigenvalues and eigenvectors in linear algebra
  • Experience with transition matrices in stochastic processes
NEXT STEPS
  • Research the properties of symmetric random walks in Markov Chains
  • Explore the concept of risk-neutral measures in financial mathematics
  • Study the implications of dominant eigenvalues in Markov processes
  • Investigate the application of transition matrices in income distribution analysis
USEFUL FOR

Mathematicians, statisticians, and data scientists interested in stochastic processes, particularly those studying Markov Chains and their applications in economics and finance.

WWGD
Science Advisor
Homework Helper
Messages
7,777
Reaction score
13,012
TL;DR
Two con
Are there known conditions under which a Markov Chain is also a Martingale? I know only that the only Random Walk that is a Martingale is the symmetric one, i.e., p= 1-p =1/2.
 
Physics news on Phys.org
If you have an nxn Markov matrix the first thing you need to decide is what does expected value mean? You have n discrete observations, are they the numbers 1 through n or something else? If your Markov chain is a random walk on a graph of n vertices the question doesn't even obviously make sense
 
  • Like
Likes   Reactions: WWGD
WWGD said:
TL;DR Summary: I know only that the only Random Walk that is a Martingale is the symmetric one, i.e., p= 1-p =1/2.
Risk neutral probabilities are martingales but <> 0.5

https://en.wikipedia.org/wiki/Risk-neutral_measure

Can arbitrarily create a martingale with any binomial process
 
  • Like
Likes   Reactions: WWGD
Thank you both. Im thinking about income decile transition matrices. If the matrix M tends to stabilize at abouth the kth iteration, I assume the dominant eigenvalues of M would be close to the kth root of unity, right?
 
Related question: Let M be an ## n \times n ## constant matrix, with constant value ##c## and let ##k ## a positive Integer. Is this formular correct : ##M^{k}=n^{k-1} c^{k} J ##, where ##J## is the constant ## n \times n ## matrix with ##c ==1##?
 
  • Like
Likes   Reactions: Gavran
WWGD said:
Related question: Let M be an ## n \times n ## constant matrix, with constant value ##c## and let ##k ## a positive Integer. Is this formular correct : ##M^{k}=n^{k-1} c^{k} J ##, where ##J## is the constant ## n \times n ## matrix with ##c ==1##?
The formula is correct.
 
  • Like
Likes   Reactions: WWGD

Similar threads

  • · Replies 6 ·
Replies
6
Views
2K
  • · Replies 8 ·
Replies
8
Views
2K
  • · Replies 12 ·
Replies
12
Views
2K
  • · Replies 24 ·
Replies
24
Views
2K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 3 ·
Replies
3
Views
28K
  • · Replies 3 ·
Replies
3
Views
2K
Replies
24
Views
4K
  • · Replies 1 ·
Replies
1
Views
2K
Replies
3
Views
2K