How Do You Correctly Express q(y,x) in the Metropolis-Hastings Algorithm?

  • Context: Graduate 
  • Thread starter Thread starter kulimer
  • Start date Start date
  • Tags Tags
    Algorithm
Click For Summary
SUMMARY

The discussion centers on the correct expression of the jump distribution, q(y,x), in the Metropolis-Hastings algorithm. The user queries how to express q(y,x) when the jump distribution is defined as normal(0,1). The formula presented, α(x,y) = min(1, π(y)q(y,x) / π(x)q(x,y)), is highlighted, emphasizing the need to relate y to x in the transition probability. The user concludes that simply stating q(y,x) = normal(0,1) is insufficient as it does not incorporate the variable y, which is essential for accurate representation.

PREREQUISITES
  • Understanding of the Metropolis-Hastings algorithm
  • Familiarity with jump distributions in Markov Chain Monte Carlo (MCMC) methods
  • Knowledge of normal distribution properties
  • Basic algebraic manipulation of variables
NEXT STEPS
  • Research the formulation of transition probabilities in MCMC methods
  • Study the implications of different jump distributions in the Metropolis-Hastings algorithm
  • Explore the relationship between acceptance ratios and transition probabilities
  • Learn about advanced topics in Bayesian statistics related to MCMC
USEFUL FOR

Statisticians, data scientists, and researchers involved in Bayesian inference and Markov Chain Monte Carlo methods will benefit from this discussion.

kulimer
Messages
9
Reaction score
0
I digged out this old tread, but it is closed. I'll repost, but with my question.
https://www.physicsforums.com/showthread.php?t=74004&highlight=metropolis

\pi(x)

and
\pi(y)

and
q(y,x) is the jump distribution

in the relation:
\alpha(x,y)= \min \left( 1,\frac{\pi (y)q(y,x)}{\pi (x)q(x,y)} \right)

Say, my jump distribution(aka transition prob) is normal(0,1). How do you write out q(y,x)? Is it \frac{1}{\sqrt{2\pi }\sigma }{{e}^{\frac{{{(x-0)}^{2}}}{2{{\sigma }^{2}}}}}?

But this doesn't make sense, because it doesn't involve y, since q(y,x) means given y, the transition probability of getting x. We are suppose to relate y to x in the equation.
 
Last edited:
Physics news on Phys.org
Variables x, y, z, in algebra, are place holders.

q(y,x)=normal(0,1) means y=0 x=1

Algebra is a incomplete story of placeholders. Be careful where you can plugin the values.
 

Similar threads

  • · Replies 1 ·
Replies
1
Views
2K
Replies
2
Views
3K
  • · Replies 15 ·
Replies
15
Views
2K
Replies
6
Views
2K
  • · Replies 48 ·
2
Replies
48
Views
12K
Replies
4
Views
3K
Replies
9
Views
2K
  • · Replies 7 ·
Replies
7
Views
4K
  • · Replies 100 ·
4
Replies
100
Views
12K
  • · Replies 8 ·
Replies
8
Views
2K