What Are the Markov Chain Probabilities for a Taxicab's Moves?

Click For Summary
SUMMARY

The discussion focuses on calculating Markov chain probabilities for a taxicab's movements between three locations: the airport, Hotel A, and Hotel B. Transition probabilities are defined as P(airport → A) = 0.7, P(airport → B) = 0.3, P(A → airport) = 0.9, P(A → B) = 0.1, P(B → airport) = 0.8, and P(B → A) = 0.2. The user successfully solved parts A and C but struggled with part B, specifically in setting up the initial probability matrix and calculating the probabilities after two moves. The correct approach involves using the transition matrix and squaring it to find the probabilities for two moves.

PREREQUISITES
  • Understanding of Markov chains and transition probabilities
  • Familiarity with matrix operations, specifically matrix multiplication
  • Knowledge of probability theory, particularly conditional probabilities
  • Experience with probability distributions and long-term behavior analysis
NEXT STEPS
  • Review matrix multiplication techniques for Markov chains
  • Study the concept of steady-state probabilities in Markov processes
  • Learn how to derive transition matrices from given probabilities
  • Explore applications of Markov chains in real-world scenarios, such as queueing theory
USEFUL FOR

Students studying probability theory, mathematicians interested in stochastic processes, and anyone working with Markov chains in applied mathematics or statistics.

lina29
Messages
84
Reaction score
0

Homework Statement


A taxicab moves between the airport, Hotel A, and Hotel B according to a Markov chain with transition probabilities:
P(airport → A) = 0.7,
P(airport → B) = 0.3,
P(A → airport) = 0.9,
P(A → B) = 0.1,
P(B → airport) = 0.8,
P(B → A) = 0.2.
A-If the taxicab starts at the airport, what is the probability that it will be at Hotel A two moves later?
B-Suppose the taxicab starts at the airport with probability 0.6 and starts at Hotel A and Hotel B with probability 0.2 each. What is the probability that it will be at Hotel B two moves later?
C- In the long run, what fraction of visits will the taxicab make to each of the three locations?


Homework Equations





The Attempt at a Solution


I have gotten the answer for parts A & C but I don't understand at all how I would set up the matrix with part B. My initial though was that the matrix was

0 .2 .8
.2 0 .8
.6 .4 0

with the first row/column being hotel A, the second row/column being hotel B, and the third row/column being the airport

then by squaring the matrix I got
.52 .32 .16
.48 .36 .16
.08 .12 .8

and then to get B I added up .32 + .12=.44 which was wrong. What did I do wrong?
 
Physics news on Phys.org
For (b): in two moves, P{at B} = P{at B|start at port}*P{start at port} + P{at B|start at A}*P{start at A} + P{at B|start at B}*P{start at B}. The conditional probabilities are given by P*P.

RGV
 

Similar threads

  • · Replies 12 ·
Replies
12
Views
2K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 6 ·
Replies
6
Views
2K
Replies
9
Views
3K
  • · Replies 6 ·
Replies
6
Views
2K
  • · Replies 11 ·
Replies
11
Views
1K
  • · Replies 3 ·
Replies
3
Views
3K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 2 ·
Replies
2
Views
4K
  • · Replies 8 ·
Replies
8
Views
2K