I need help with this
Consider an irreducible Markov chain with $\left|S\right|<\infty $ and transition function $p$.
Suppose that $p\left(x,x\right)=0,\ x\in S$ and that the chain has a stationary distribution $\pi .$
Let $p_x,x\ \in S,$ such that $0<\ p_x<1$ and $Q\left(x,y\right),\ x\in...