Recent content by hsinyihhsu

Homework Statement This is not really a homework question but just something that I'm confused about. I'm having trouble with understanding the movement of Markov chain. Say, if S = {0,1,2...} and 0<q<1. Let p(i,i+1)=q and p(i,i-1)=1-q. I can see how this Markov chain moves (back and forth...