1. Limited time only! Sign up for a free 30min personal tutor trial with Chegg Tutors
    Dismiss Notice
Dismiss Notice
Join Physics Forums Today!
The friendliest, high quality science and math community on the planet! Everyone who loves science is here!

Homework Help: Limit for Markov Chains

  1. Mar 11, 2012 #1
    1. The problem statement, all variables and given/known data

    Consider:

    [itex]P=\left( \begin{array}{cc} 0 & 1 \\ 1 & 0 \end{array} \right)[/itex]

    Show that [itex]P^n[/itex] has no limit, but that: [itex]A_n=\frac{1}{n+1}(I+P+P^2+\ldots+P^n)[/itex] has a limit.

    3. The attempt at a solution

    I can see that [itex]P^{EVEN}=\left( \begin{array}{cc} 1 & 0 \\ 0 & 1 \end{array} \right)[/itex] and [itex]P^{ODD}=\left( \begin{array}{cc} 0 & 1 \\ 1 & 0 \end{array} \right)[/itex], so a steady state is never reached, but I can't figure out the second part.

    Any suggestions?
     
  2. jcsd
  3. Mar 11, 2012 #2

    Office_Shredder

    User Avatar
    Staff Emeritus
    Science Advisor
    Gold Member

    So for example

    I+P+P2+P3+P4+P5 =
    [3 3]
    [3 3]

    and when you divide this by six you get a matrix with all 1/2s. Try adding up some more guys and see what happens
     
Share this great discussion with others via Reddit, Google+, Twitter, or Facebook