MHB Markov Chains with No Limit: Proving Convergence for $A_n$

  • Thread starter Thread starter Jason4
  • Start date Start date
  • Tags Tags
    Limit
Click For Summary
The discussion focuses on the properties of the matrix P, defined as P = [[0, 1], [1, 0]], and its powers. It is established that P^n does not converge to a limit, alternating between the identity matrix for even n and P for odd n. However, the sequence A_n, defined as A_n = (1/(n+1))(I + P + P^2 + ... + P^n), does converge to a limit. The convergence of A_n is demonstrated through the averaging of the oscillating behavior of P. The key takeaway is that while P itself does not stabilize, the average of its powers does converge.
Jason4
Messages
27
Reaction score
0
Consider:

$P=\left( \begin{array}{cc} 0 & 1 \\ 1 & 0 \end{array} \right)$

Show that $P^n$ has no limit, but that: $A_n=\frac{1}{n+1}(I+P+P^2+\ldots+P^n)$ has a limit.

I can see that $P^{EVEN}=\left( \begin{array}{cc} 1 & 0 \\ 0 & 1 \end{array} \right)$ and $P^{ODD}=\left( \begin{array}{cc} 0 & 1 \\ 1 & 0 \end{array} \right)$, so a steady state is never reached, but I can't figure out the second part.

Any suggestions?
 
Physics news on Phys.org
Jason said:
Consider:
$P=\left( \begin{array}{cc} 0 & 1 \\ 1 & 0 \end{array} \right)$
Show that $P^n$ has no limit, but that: $A_n=\frac{1}{n+1}(I+P+P^2+\ldots+P^n)$ has a limit.
$\sum\limits_{k = 0}^N {{P^k}} = \left\{ {\begin{array}{rl}{\tfrac{1}{2}\left[ {\begin{array}{rl}{N + 2}&N\\N&{N + 2}\end{array}} \right]}&{,N\text{ even}}\\{\tfrac{{N + 1}}{2}\left[ {\begin{array}{rl}1&1\\1&1\end{array}} \right]}&{,N\text{ odd}}\end{array}} \right.$
 
There is a nice little variation of the problem. The host says, after you have chosen the door, that you can change your guess, but to sweeten the deal, he says you can choose the two other doors, if you wish. This proposition is a no brainer, however before you are quick enough to accept it, the host opens one of the two doors and it is empty. In this version you really want to change your pick, but at the same time ask yourself is the host impartial and does that change anything. The host...

Similar threads

  • · Replies 2 ·
Replies
2
Views
1K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 1 ·
Replies
1
Views
1K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K
Replies
2
Views
2K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 8 ·
Replies
8
Views
2K
  • · Replies 9 ·
Replies
9
Views
2K