Homework Statement
This is not really a homework question but just something that I'm confused about.
I'm having trouble with understanding the movement of Markov chain.
Say, if S = {0,1,2...} and 0<q<1. Let p(i,i+1)=q and p(i,i-1)=1-q. I can see how this Markov chain moves (back and forth...