Dismiss Notice
Join Physics Forums Today!
The friendliest, high quality science and math community on the planet! Everyone who loves science is here!

Markov Chain/ Monte Carlo Simulation

  1. Jan 23, 2008 #1
    Let [tex] \bold{X} [/tex] be a discrete random variable whose set of possible values is [tex] \bold{x}_j, \ j \geq 1 [/tex]. Let the probability mass function of [tex] \bold{X} [/tex] be given by [tex] P \{\bold{X} = \bold{x}_j \}, \ j \geq 1 [/tex], and suppose we are interested in calculating [tex] \theta = E[h(\bold{X})] = \sum_{j=1}^{\infty} h(\bold{x}_j) P \{\bold{X} = \bold{x}_j \} [/tex].

    In some cases, why are Markov Chains better for estimating [tex] \theta [/tex] as opposed to Monte-Carlo simulations? If we wanted to calculate [tex] E[\bold{X}] [/tex] there would not be any need to use simulation at all, right?

    And [itex] \lim_{n \to \infty} \frac{h(\bold{x}_j)}{n} \approx \theta \ \? [/itex]?
  2. jcsd
Know someone interested in this topic? Share this thread via Reddit, Google+, Twitter, or Facebook

Can you offer guidance or do you also need help?
Draft saved Draft deleted

Similar Discussions: Markov Chain/ Monte Carlo Simulation
  1. Monte Carlo Simulation (Replies: 9)

  2. Monte carlo simulation (Replies: 3)