• Support PF! Buy your school textbooks, materials and every day products Here!

Markov chain - stationary distribution - please help

  • Thread starter Carolyn
  • Start date
37
0
1. Homework Statement

-A taxi is located either at the airport or in the city. From the city, the next trip is to the airport with 1/4 probability, or to somewhere else in the city with 3/4. From the airport, the next trip is always to the city.

(a) find the stationary distribution
(b) starting from the airport, what is the expected number of trips until its next visit to the airport?

2. Homework Equations



3. The Attempt at a Solution

The matrix I got is

0 1
1/4 3/4

but I am having trouble solving for the stationary distribution and expected number of trips. Somehow, I don't think the stationary distribution even exists. But it should. What am I missing? Thanks.
 

Answers and Replies

hello carolyn

your transition matrix is same as expected.And the stationary distribution exists. you can find the stationary distribution by solving it as two linear equations.
let 'Pij' be the element, i=1,2 and j=1,2 (for the given transition matrix).

P0=P0*P00+P1*P01; P1=P0*P10+P1*P11

here P0 and P1 are unknowns , the elements of stationary distribution.
Pij(P00,P01,P10,P11) are the transition matrix elements.

By substituting you will get P0=P0*0+P1*(1/4); P1=P0*1+P1*(3/4).

Also the condition to find P0 and P1 is P0+P1=1(the raw sum =1);

then u will get a stationary distribution of
[1/5 4/5]
 

Related Threads for: Markov chain - stationary distribution - please help

Replies
2
Views
1K
Replies
2
Views
13K
Replies
1
Views
1K
  • Last Post
Replies
0
Views
776
  • Last Post
Replies
9
Views
839
  • Last Post
Replies
0
Views
2K
  • Last Post
Replies
0
Views
1K
  • Last Post
Replies
9
Views
4K
Top