Dismiss Notice
Join Physics Forums Today!
The friendliest, high quality science and math community on the planet! Everyone who loves science is here!

Homework Help: Help with determining the transition matrix for a markov chain

  1. Dec 12, 2008 #1
    1. The problem statement, all variables and given/known data
    well i have my algebra exam coming up and my teacher told us that there is going to be a markov chain problem. the only problem i have is that i dont know how to get the initial transition matrix, which is crucial in getting full marks. can someone help me in determining how to get it from this problem:
    a wolf pack hunts in one of 3 regions, its habits are as follows
    1. if it hunts in one region one day it is as likely not to hunt there the next day
    2. if it hunts in the first region, it never hunts in the second region the next day
    3. if it hunts in the 2nd or 3rd, it is equally likely to hunt in each of the other regions the next day

    2. Relevant equations


    3. The attempt at a solution
    this is an example from the textbook so they give the transition matrix as
    0.5 0.25 0.25
    0 0.5 0.25
    0.5 0.25 0.5
    given the above habits, i have trouble finding the transition matrix not only for this but other problems also, if someone can explain it, im sure i can pick up on it pretty easily.
  2. jcsd
Share this great discussion with others via Reddit, Google+, Twitter, or Facebook

Can you offer guidance or do you also need help?
Draft saved Draft deleted