Markov Chains with No Limit: Proving Convergence for $A_n$

  • Context:
  • Thread starter Thread starter Jason4
  • Start date Start date
  • Tags Tags
    Limit
Join the discussion
Ask a follow-up here, or get your own question answered by working scientists, mathematicians and engineers — people, not an autocomplete.
Real named experts · corrections over time · the nuance an AI answer skips
1 replies · 2K views
Jason4
Messages
27
Reaction score
0
Consider:

$P=\left( \begin{array}{cc} 0 & 1 \\ 1 & 0 \end{array} \right)$

Show that $P^n$ has no limit, but that: $A_n=\frac{1}{n+1}(I+P+P^2+\ldots+P^n)$ has a limit.

I can see that $P^{EVEN}=\left( \begin{array}{cc} 1 & 0 \\ 0 & 1 \end{array} \right)$ and $P^{ODD}=\left( \begin{array}{cc} 0 & 1 \\ 1 & 0 \end{array} \right)$, so a steady state is never reached, but I can't figure out the second part.

Any suggestions?
 
on Phys.org
Jason said:
Consider:
$P=\left( \begin{array}{cc} 0 & 1 \\ 1 & 0 \end{array} \right)$
Show that $P^n$ has no limit, but that: $A_n=\frac{1}{n+1}(I+P+P^2+\ldots+P^n)$ has a limit.
$\sum\limits_{k = 0}^N {{P^k}} = \left\{ {\begin{array}{rl}{\tfrac{1}{2}\left[ {\begin{array}{rl}{N + 2}&N\\N&{N + 2}\end{array}} \right]}&{,N\text{ even}}\\{\tfrac{{N + 1}}{2}\left[ {\begin{array}{rl}1&1\\1&1\end{array}} \right]}&{,N\text{ odd}}\end{array}} \right.$