Linear Algebra; Stochastic matrix and Steady State vectors

Join the discussion
Ask a follow-up here, or get your own question answered by working scientists, mathematicians and engineers — people, not an autocomplete.
Real named experts · corrections over time · the nuance an AI answer skips
2 replies · 12K views
MustangGt94
Messages
9
Reaction score
0

Homework Statement



Question: 18. Show that every 2 x 2 stochastic matrix has at least one steady-state vector. Any such matrix can be written as

P = |1-a b |
| a 1-b |

where a and b are constants between 0 and 1. (There are two linearly independent steady-state vectors if a = b = 0. Otherwise, there is only one.)

The Attempt at a Solution



I am guessing that they want me to show that the above matrix has a solution to the equation Px = x so that the steady state vector exists since there is a solution. My solution was that since a and b are other constants between 0 and 1 the matrix would have a solution?

Thank you for the help!
 
Physics news on Phys.org
Hi Mustang,

[tex]P = \begin{pmatrix} 1-a & b\\ a & 1-b\end{pmatrix}[/tex]

Consider that if Px = x, then Px - x = 0, i.e., (P - I)x = 0, where I is the 2x2 identity matrix. As a steady state vector (just a certain type of "eigenvector", if you are familiar with the term) is necessarily nonzero, recall how one can use the determinant to determine where the system Ax=0 has a nonzero solution.
 
Last edited:
Ah! I see what you mean, thanks a lot Unco, much appreciated!