1. Limited time only! Sign up for a free 30min personal tutor trial with Chegg Tutors
    Dismiss Notice
Dismiss Notice
Join Physics Forums Today!
The friendliest, high quality science and math community on the planet! Everyone who loves science is here!

Homework Help: Transition Matrix ( Markov Chain Monte Carlo)

  1. Jun 14, 2013 #1
    1. -Find a regular transition matrix that is not time reversible, i.e., doesn't satisfy the
    balance equations?

    2.Pi,j=0≠Pj,ifor some i and j

    My understanding from Markov Chain Monte Carlo is that for the transition matrix to be regular the matrix has to have all positives entries and each row will add up to one. I was thinking the trick to this problem for it not satisfy the balance equation would be to take the transpose of the transition matrix. I was hoping someone could give me a hint if I am on the right track of thinking and where to go from there.
  2. jcsd
  3. Jun 14, 2013 #2

    Ray Vickson

    User Avatar
    Science Advisor
    Homework Helper

    Your understanding is incorrect: P can be regular and have lots of zero entries. The regularity requirement is that some power ##P^n## has all positive entries. Also, your equation ##P_{ij} = 0 \neq P_{ji}## for some ##i,j## is likely not enough, nor is it needed.

    You will probably get nowhere by taking the transpose of a transition matrix, since that will rarely give back a transition matrix again; if it does we call the transition matrix "doubly stochastic", and such transition matrices are rare.

    Why not just try some more-or-less random (regular) transition matrices? They are unlikely to be reversible.
  4. Jun 15, 2013 #3
    Thanks for your help.
  5. Jun 15, 2013 #4
    I am still a little confused on how a regular transition matrix could not be reversible. Also what is meant by the statement Pij=0≠Pji for some i,j. Thanks
Share this great discussion with others via Reddit, Google+, Twitter, or Facebook

Have something to add?
Draft saved Draft deleted