MHB How Do I Create a Transition Matrix for This Markov Chain Scenario?

AI Thread Summary
The discussion focuses on creating a transition matrix for a Markov chain involving three food states: Chinese, Greek, and Italian. The student is trying to translate the scenario into mathematical notation, noting that the probabilities must sum to 1. Key points include that if the student eats Chinese, the next meal can be Greek or Italian with equal likelihood, while eating Greek increases the likelihood of Chinese over Italian, and eating Italian increases the likelihood of Chinese over Greek. The transition matrix will be a 3x3 matrix where each element represents the probability of moving from one state to another, with certain elements being zero due to the constraint of not eating the same type of food consecutively. The student is seeking clarity on how to properly formulate these probabilities in the matrix.
spence1
Messages
1
Reaction score
0
I just discovered this website and want to thank everyone who is willing to contribute some of their time to help me. I appreciate it more than you know

First off, assume that state 1 is Chinese and that state 2 is Greek, and state 3 is Italian.

A student never eats the same kind of food for 2 consecutive weeks. If she eats a Chinese restaurant one week, then she is equally likely to have Greek as Italian food the next week. If she eats a Greek restaurant one week, then she is four times as likely to have Chinese as Italian food the next week. If she eats a Italian restaurant one week, then she is twice as likely to have Chinese as Greek food the next week.

I feel like I am on the right track, but I'm having trouble translating the words to notation (the most important part).
Chinese could be represented by x, Greek by y, and Italian by z, correct? And that has to add up to 1?

"If she eats a Greek restaurant one week, then she is four times as likely to have Chinese as Italian food the next week."
(I'm using ... to mean I think that there is something more in the equation)

y=4x...

"If she eats an Italian restaurant one week, then she is twice as likely to have Chinese as Greek food the next week."

z=2x...
So yeah. I kinda get the idea, I kinda don't. I think
 
Last edited:
Physics news on Phys.org
spence said:
"If she eats a Greek restaurant one week, then she is four times as likely to have Chinese as Italian food the next week."
(I'm using ... to mean I think that there is something more in the equation)

y=4x...

"If she eats an Italian restaurant one week, then she is twice as likely to have Chinese as Greek food the next week."

z=2x...

She eats restaurants?
 
spence said:
I just discovered this website and want to thank everyone who is willing to contribute some of their time to help me. I appreciate it more than you know

First off, assume that state 1 is Chinese and that state 2 is Greek, and state 3 is Italian.

A student never eats the same kind of food for 2 consecutive weeks. If she eats a Chinese restaurant one week, then she is equally likely to have Greek as Italian food the next week. If she eats a Greek restaurant one week, then she is four times as likely to have Chinese as Italian food the next week. If she eats a Italian restaurant one week, then she is twice as likely to have Chinese as Greek food the next week.

I feel like I am on the right track, but I'm having trouble translating the words to notation (the most important part).
Chinese could be represented by x, Greek by y, and Italian by z, correct? And that has to add up to 1?

"If she eats a Greek restaurant one week, then she is four times as likely to have Chinese as Italian food the next week."
(I'm using ... to mean I think that there is something more in the equation)

y=4x...

"If she eats an Italian restaurant one week, then she is twice as likely to have Chinese as Greek food the next week."

z=2x...
So yeah. I kinda get the idea, I kinda don't. I think
In this problem there are three states: Chinese, Greek and Italian. The transition matrix tells you the probability of changing from one state to another. So it will be a $3\times3$ matrix. The rows and columns of the matrix will correspond to the states. So row 1 corresponds to Chinese, row 2 to Greek, and row 3 to Italian, and similarly for the columns. The $(i,j)$-element of the matrix give the probability of changing from state $j$ to state $i$. So for example the $(1,1)$-element of the matrix is the probability of changing from Chinese to Chinese. But the student never eats the same kind of food for 2 consecutive weeks. That tells you that the $(1,1)$-element of the matrix is $0$.

The $(2,1)$-element is the probability of changing from Chinese to Greek, and the $(3,1)$-element is the probability of changing from Chinese to Italian. Those probabilities must add up to $1$, and you are told that they are both equally llikely. So they must both be $\frac12$. The first column of the matrix is therefore $\begin{bmatrix}0 \\ \frac12 \\ \frac12 \end{bmatrix}$.

Now you have to do the same thing for the other two columns.
 
Back
Top