# Transition matrix

Tags:
1. May 15, 2017

### Mark53

1. The problem statement, all variables and given/known data
Define a simple random walk Yn on a finite state space S = {0, 1, 2, . . . , N} to be a random process that
• increases by 1, when possible, with probability p,
• decreases by 1, when possible, with probability 1 − p, and
• remains unchanged otherwise.
(a) Specify the transition matrix for Yn.

(b) Assume that N = 2 and initially, the process is evenly distributed across S. Calculate the probability the process is in state 0 after 2 steps.

3. The attempt at a solution

\begin{pmatrix}
1-p & p & 0 \\ 1-p & 0 & p \\ 0 & 1-p & p

would this matrix be correct not sure about the first entry

b)

Just need to calculate P^2 and see what the probability is in state 0.
Need the correct matrix to do this first

2. May 15, 2017

### andrewkirk

Yes that matrix looks like it implements the rules you wrote.

3. May 15, 2017

### andrewkirk

The 'otherwise' is needed because in some cases one cannot do an increase, and in other cases one cannot decrease. The 'otherwise' pushes the unused probability into the diagonal entry in that row. That tells us what to do in rows 0 and 2.

4. May 15, 2017

### FactChecker

I stand corrected. I missed the "if possible" and the "Assume N=2". Sorry. I agree that the matrix is correct for N=2.
You are correct. I deleted my wrong post. Sorry.