How Can MCMC Methods Aid in Bayesian Parameter Estimation for Complex Models?

Click For Summary
SUMMARY

This discussion focuses on the application of Markov Chain Monte Carlo (MCMC) methods for Bayesian parameter estimation in complex models with multiple adjustable parameters. The user seeks software recommendations for performing Bayesian analysis using MCMC techniques, particularly in the context of a "black box" model that solves differential equations. R's MCMCpack is mentioned as a tool already in use, primarily for Bayesian linear regression, but the user is looking for more specialized software like BUGS for handling complex models. The need for beginner-friendly resources on MCMC applications is also highlighted.

PREREQUISITES
  • Understanding of Bayesian parameter estimation
  • Familiarity with MCMC methods
  • Experience with R programming language
  • Knowledge of differential equations and their numerical solutions
NEXT STEPS
  • Explore MCMCpack documentation for advanced modeling techniques
  • Research the use of BUGS for Bayesian analysis of complex models
  • Learn about the implementation of MCMC methods in Python using PyMC3
  • Study resources on Bayesian inference and MCMC applications in scientific research
USEFUL FOR

Researchers, statisticians, and data scientists involved in Bayesian analysis, particularly those working with complex models and differential equations.

witziger_Fuchs
Messages
2
Reaction score
0
Hi folks.

I have the following question.I have a model M containing 20 adjustable parameters k = {k_j}.
I also have 40-50 measured temporal profiles e = {e_i} at my disposal.

I can use M to predict the experimental values after solving complex systems of differential equations.Consequently, I get m(k) = {m_i(k)} which I can compare to e = {e_i}.Now, I want to perform a Bayesian parameter estimation of the system.I am going to define a (first) prior distribution for the parameters k: p_0(k)
Afterwards, I want to get the posterior probability distribution of k: f_p(k) = p(k|e) = L(e|k)*p_0(k)/p(e).
(Whereby p(e) represents, of course, a very complex multi-dimensional integral of "L(e|k)*p_0(k)".Naturally, I cannot compute analytically the solution.
It also stands to reason that an approximate calculation of f_p(k) (and integration of "L(e|k)*p_0(k)") would be computationally intractable.I read that Macrov-Chain-Monte-Carlo (MCMC) methods should be used for computing quantities of interest characterising the posterior (such as the points of highest probability density and high probability density regions, whose bounds can serve as error bars).
To be frank, I am a novice in that field. Do you know any MCMC software freely available to academic researchers which could carry out all these operations, given a "black box" m(k) relying on solving differential equation systems?
If so, are you also aware of any beginner-friendly introduction into the concrete application of these techniques?

I'd be very grateful for your answers.Kind regards.
 
Physics news on Phys.org
I use R with the MCMCpack for my Bayesian estimation needs. It has always served me well, however I have never tried the kind of differential equation black box approach like you are describing. I have essentially only used it to do Bayesian linear regression were the residuals were assumed to be normally distributed and the Bayesian approach estimates the posterior of the linear model parameters and the residual variance.

I know that MCMCpack has built in routines for more complicated models, but I just haven't used them. You may need to try something more specialized, such as BUGS, but I have no experience with that.
 

Similar threads

  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 9 ·
Replies
9
Views
3K
  • · Replies 1 ·
Replies
1
Views
1K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 11 ·
Replies
11
Views
3K
  • · Replies 19 ·
Replies
19
Views
4K
  • · Replies 15 ·
Replies
15
Views
6K
  • · Replies 4 ·
Replies
4
Views
4K
  • · Replies 1 ·
Replies
1
Views
4K
  • · Replies 105 ·
4
Replies
105
Views
15K