I've attached the diagram of 4 rooms, which a rat must move through. Each period he changes his room (his state). As you can see if you click on the image, the rat cannot access room 2 from 3, vice versa.(adsbygoogle = window.adsbygoogle || []).push({});

If I assume the rat begins in room 1, how do I calculate the probability he will be in room 4 after his second move? I have the transitional probability matrix correct, I'm just not sure how to move forward.

Thank you,

Jeff

**Physics Forums - The Fusion of Science and Community**

Dismiss Notice

Join Physics Forums Today!

The friendliest, high quality science and math community on the planet! Everyone who loves science is here!

The friendliest, high quality science and math community on the planet! Everyone who loves science is here!

# Markov Chain - Rat w/4 Rooms

Loading...

Similar Threads - Markov Chain Rooms | Date |
---|---|

Markov chain question | Jun 4, 2013 |

Regularity of P and Markov chains! | Oct 13, 2012 |

Any fast way to compute the fixed vector of a Markov chain transistion matrix? | Jun 8, 2011 |

Exponential of (Markov Chain) Transition matrix | Oct 6, 2009 |

Anyone knows about Markov Chains? | Apr 24, 2005 |

**Physics Forums - The Fusion of Science and Community**