- #1

modelling

- 10

- 0

## Homework Statement

A Markov process with 4 states evolves in unit time steps with a transition probability

matrix given by

P =

|0.5 0 0.3 0.2|

|0.1 0.4 0.2 0.3|

| 0 0.4 0.4 0.2|

|0.1 0.1 0.1 0.7|

Find the equilibrium probabilities for this system. What is the most likely state for the

system after many time steps?

## Homework Equations

Im not sure what equations to use

## The Attempt at a Solution

I have written the first two steps free hand using the method on this video at 33 minutes in but I am not sure if I need to use a formula instead of writing it out fully. Its taking a very long time and I only have up to n=2 steps.

Last edited by a moderator: