Recent content by modelling

  1. M

    Markov equilibrium probabilities

    Ok I've figured out the gaussian elimination method and I'm getting the right answer now. Thanks for the help !
  2. M

    Markov equilibrium probabilities

    just solving it out there I think I've got a=0,b=d,c=-1,d=1/b.. Thats probably rubbish. What seems strange is that this question is worth about only 2 or 3 marks in the exam and I don't know how it takes this long.. especially solbing the equations for a,b,c,d I need to be able to do this in an...
  3. M

    Markov equilibrium probabilities

    Whats the best way to solve the system at this stage ? Sorry I haven't solved equations like these in a long time.
  4. M

    Markov equilibrium probabilities

    Ok now I have: -0.5a + 0.1b + 0c + 0.1d = 0 0a - 0.6b + 0.4c + 0.1d = 0 0.3a + 0.2b -0.6c + 0.1d = 0 0.2a + 0.3b + 0.2c - 0.3d = 0 So the next step is: a + b + c + d = 1 0a - 0.6b + 0.4c + 0.1d = 0 0.3a + 0.2b - 0.6c + 0.1d = 0 0.2a + 0.3b + 0.2c - 0.3d = 0 ? Whats the fastest way to solve...
  5. M

    Markov equilibrium probabilities

    I have each equation setup as 0.5a +0.1b + 0c + 0.1d = a 0a + 0.4b + 0.4c + 0.1d = b 0.3a + 0.2b + 0.4c + 0.1d = c 0.2a + 0.3b + 0.2c + 0.7d = d Not sure how what to do next..
  6. M

    Markov equilibrium probabilities

    Is it possible to calculate the initial state vector then do the brute force method instead of having to go through the longer method which involves the x, y equations etc.. ? Can i determine what my initial state vector is by looking at my transition matrix ? Possibly through eigenve
  7. M

    Markov equilibrium probabilities

    I've watched the lecture and been reading over it but still don't know how to answer the question. Please help
  8. M

    Markov equilibrium probabilities

    I found how to multiply the matrix to get the 2nd/3rd/4th stage and so on but it is very slow by hand because i have to find each individual value for the matrix. I don't understand what they mean by find the equilibrium probabilities ? and what is the most likely state after many steps ...
  9. M

    Markov equilibrium probabilities

    Homework Statement A Markov process with 4 states evolves in unit time steps with a transition probability matrix given by P = |0.5 0 0.3 0.2| |0.1 0.4 0.2 0.3| | 0 0.4 0.4 0.2| |0.1 0.1 0.1 0.7| Find the equilibrium probabilities for this system. What is the most likely state...
Back
Top