How to incorporate evidence into parameters of a Bayesian network?

In summary, Bayesian inference in tree structured networks is done by sum-product updating the marginal distributions of the nodes.
  • #1
sarikan
7
0
Greetings,
Maybe I'm getting a little bit confused, but I'm looking for resources which explain how to update parameters of a Bayesian network as a result of observations.

There are various inference methods, but unless I'm missing something here, these methods produce a posterior distribution based on evidence (a set of observations of some nodes).

This posterior distribution is specific to the evidence, but there must be a way of incorporating this into the network, so that the prior distribution of the following observations are modified.

Can I simply use the posterior distribution after observation of evidence E as the prior for the next? This should correspond to a Bayesian update of the network, but I fear that they me be a catch here. Would this be the right way of continuously updating the parameters of the network as evidence is observed?

Regards
 
Physics news on Phys.org
  • #2
sarikan said:
Greetings,


Can I simply use the posterior distribution after observation of evidence E as the prior for the next? This should correspond to a Bayesian update of the network, but I fear that they me be a catch here. Would this be the right way of continuously updating the parameters of the network as evidence is observed?
Regards

This paper may be helpful. You generally need to create conjugate priors as you update. If you are starting with an uninformative prior or hyperparameters (of prior distributions) the process is more complicated.

http://cran.r-project.org/web/packages/LaplacesDemon/vignettes/BayesianInference.pdf
 
Last edited:
  • #3
Thanks. A good overall paper it appears. I'll read it in detail. Conjugacy is useful, though I approach it with some hesitation, since my work may end up with arbitrary distributions, where conjugacy may not be possible.
I think I've found the right term for what I'm looking for by the way: adaptive inference in Bayesian networks. For anyone else who may look for something similar in the future...

Regards
 
  • #4
sarikan said:
Thanks. A good overall paper it appears. I'll read it in detail. Conjugacy is useful, though I approach it with some hesitation, since my work may end up with arbitrary distributions, where conjugacy may not be possible.
I think I've found the right term for what I'm looking for by the way: adaptive inference in Bayesian networks. For anyone else who may look for something similar in the future...

Regards

Here's a paper on adaptive Bayesian inference based on tree structured networks. It describes the sum-product updating algorithm for re-evaluating marginal distributions and other quantities and proposes a faster alternative. I can't say I have any experience in this particular area of Bayesian applications, but it looks interesting.

http://people.cs.uchicago.edu/~osumer/nips07.pdf
 
Last edited:
  • #5
,

I can provide some insights on how to incorporate evidence into parameters of a Bayesian network. First, it is important to understand that Bayesian networks are probabilistic graphical models that represent relationships between variables and their probabilities. These probabilities, also known as parameters, can be updated based on new evidence using Bayesian inference methods.

One approach to incorporating evidence into parameters of a Bayesian network is by using the Bayesian updating formula. This formula takes into account the prior distribution (based on previous knowledge) and the likelihood of the evidence to calculate the posterior distribution (updated probabilities). This posterior distribution can then be used as the prior for the next set of observations, allowing for continuous updating of the network's parameters.

Another approach is to use Markov Chain Monte Carlo (MCMC) methods, which involve simulating a large number of possible networks and selecting the one that best fits the observed data. This method can be useful when dealing with complex networks with many variables.

Incorporating evidence into parameters of a Bayesian network requires careful consideration of the type and strength of the evidence, as well as the structure of the network. It is important to properly model the relationships between variables and to use appropriate inference methods to update the parameters.

In conclusion, incorporating evidence into parameters of a Bayesian network involves using Bayesian inference methods such as the Bayesian updating formula or MCMC. It is crucial to carefully consider the evidence and the structure of the network to ensure accurate and meaningful updates of the parameters.
 

FAQ: How to incorporate evidence into parameters of a Bayesian network?

1. How do I determine the appropriate evidence to incorporate into a Bayesian network?

The first step in incorporating evidence into a Bayesian network is to identify the variables in the network that are relevant to your research question. This can be done through literature review, expert knowledge, or data analysis. Once relevant variables have been identified, you can then determine which variables to include as evidence based on their impact on the network's parameters.

2. What types of evidence can be incorporated into a Bayesian network?

There are two types of evidence that can be incorporated into a Bayesian network: hard evidence and soft evidence. Hard evidence refers to data or observations that are known to be true, while soft evidence refers to uncertain or probabilistic information. Both types of evidence can be valuable in updating the parameters of a Bayesian network.

3. How do I update the parameters of a Bayesian network with new evidence?

The most common method for updating the parameters of a Bayesian network with new evidence is through a process called Bayesian inference. This involves using Bayes' rule to calculate the new probabilities for each variable in the network based on the prior probabilities and the new evidence. There are also other methods, such as maximum likelihood estimation, that can be used depending on the specific needs of the research.

4. Can evidence be incorporated into a pre-existing Bayesian network?

Yes, evidence can be incorporated into a pre-existing Bayesian network. In fact, updating the parameters of a Bayesian network with new evidence is one of the main benefits of using this type of model. As long as the structure of the network remains the same, new evidence can be easily incorporated and the parameters can be updated accordingly.

5. Are there any limitations to incorporating evidence into a Bayesian network?

While Bayesian networks are a powerful tool for incorporating evidence into a model, there are some limitations to consider. One limitation is the assumption of conditional independence between variables, which may not always hold in real-world scenarios. Additionally, the accuracy of the updated parameters is dependent on the quality of the evidence incorporated and the structure of the network itself.

Back
Top