Markov Chains with No Limit: Proving Convergence for $A_n$

  • Context: MHB 
  • Thread starter Thread starter Jason4
  • Start date Start date
  • Tags Tags
    Limit
Click For Summary
SUMMARY

The discussion focuses on the convergence properties of the matrix sequence defined by $A_n=\frac{1}{n+1}(I+P+P^2+\ldots+P^n)$, where $P=\left( \begin{array}{cc} 0 & 1 \\ 1 & 0 \end{array} \right)$. It is established that while $P^n$ does not converge, $A_n$ does converge to a limit as $n$ approaches infinity. The sequence $P^n$ oscillates between the identity matrix for even $n$ and $P$ for odd $n$, indicating that a steady state is never reached.

PREREQUISITES
  • Understanding of matrix operations and powers
  • Familiarity with Markov Chains and their properties
  • Knowledge of convergence concepts in linear algebra
  • Basic understanding of the identity matrix and its role in matrix sequences
NEXT STEPS
  • Study the properties of Markov Chains and their transition matrices
  • Explore the concept of convergence in sequences of matrices
  • Learn about the role of eigenvalues and eigenvectors in matrix convergence
  • Investigate the implications of oscillating sequences in linear algebra
USEFUL FOR

Mathematicians, students studying linear algebra, and researchers interested in Markov Chains and their convergence properties will benefit from this discussion.

Jason4
Messages
27
Reaction score
0
Consider:

$P=\left( \begin{array}{cc} 0 & 1 \\ 1 & 0 \end{array} \right)$

Show that $P^n$ has no limit, but that: $A_n=\frac{1}{n+1}(I+P+P^2+\ldots+P^n)$ has a limit.

I can see that $P^{EVEN}=\left( \begin{array}{cc} 1 & 0 \\ 0 & 1 \end{array} \right)$ and $P^{ODD}=\left( \begin{array}{cc} 0 & 1 \\ 1 & 0 \end{array} \right)$, so a steady state is never reached, but I can't figure out the second part.

Any suggestions?
 
Physics news on Phys.org
Jason said:
Consider:
$P=\left( \begin{array}{cc} 0 & 1 \\ 1 & 0 \end{array} \right)$
Show that $P^n$ has no limit, but that: $A_n=\frac{1}{n+1}(I+P+P^2+\ldots+P^n)$ has a limit.
$\sum\limits_{k = 0}^N {{P^k}} = \left\{ {\begin{array}{rl}{\tfrac{1}{2}\left[ {\begin{array}{rl}{N + 2}&N\\N&{N + 2}\end{array}} \right]}&{,N\text{ even}}\\{\tfrac{{N + 1}}{2}\left[ {\begin{array}{rl}1&1\\1&1\end{array}} \right]}&{,N\text{ odd}}\end{array}} \right.$
 

Similar threads

  • · Replies 2 ·
Replies
2
Views
1K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 1 ·
Replies
1
Views
1K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K
Replies
2
Views
3K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 7 ·
Replies
7
Views
2K
  • · Replies 8 ·
Replies
8
Views
2K