Stationary distribution of countable Markov chain

Join the discussion
Ask a follow-up here, or get your own question answered by working scientists, mathematicians and engineers — people, not an autocomplete.
Real named experts · corrections over time · the nuance an AI answer skips
1 reply · 3K views
shoplifter
Messages
26
Reaction score
0
How do I find the stationary distribution of the Markov chain with the countable state space {0, 1, 2, ..., n, ...}, where each point, including 0, can either

a. return to 0 with probability 1/2, or
b. move to the right n -> n+1 with probability 1/2?

Thanks.
 
Physics news on Phys.org
Prob. of state n = (1/2)^(n+1). This is obtained by calculation of steady state of
{0,1,..n} and letting n -> infinity.