1. Limited time only! Sign up for a free 30min personal tutor trial with Chegg Tutors
    Dismiss Notice
Dismiss Notice
Join Physics Forums Today!
The friendliest, high quality science and math community on the planet! Everyone who loves science is here!

Rat and Cat Markov Chain

  1. Apr 18, 2009 #1
    1. The problem statement, all variables and given/known data
    Rat and Cat move between room 1 and 2 using different paths. Their motions are governed by their respective transition matrices:

    [0.9, 0.1 ; 0.2, 0.8] [0.6, 0.4 ; 0.3, 0.7]

    (semi colon is a new line in the matrix, like in matlab)

    If they are ever in the same room, cat eats rat. What is the probability that rat will survive? How long on average will he survive? Hint: denote the state (i,j) where i is the location of the rat and j is the location of the cat.

    2. Relevant equations

    No idea what is even relevant to the problem.

    3. The attempt at a solution

    Well, I haven't got the foggiest idea where to start. I think that the Markov chains are independent of one another and haven't got a clue how to deal with that, because I've never seen a problem like this one before.

    The hint sort of suggests to me that you only need one transition matrix, so my only idea is that you multiply the matrices together.

    Any help appreciated.
  2. jcsd
  3. Apr 19, 2009 #2
    If you denote the states (i,j), how many states are possible?

    What would the size of your transition matrix be, given this number of states?

    If you are in state (i,j), what would the probability of a transition to (k,l) be?

    Once you have created the correct transition matrix, the rest of the problem should follow.
Know someone interested in this topic? Share this thread via Reddit, Google+, Twitter, or Facebook

Similar Discussions: Rat and Cat Markov Chain
  1. Markov chain (Replies: 0)

  2. Markov chains (Replies: 0)

  3. Markov Chain (Replies: 1)

  4. Markov chains (Replies: 0)

  5. Markov Chain (Replies: 1)