Understanding Joint Probability Model

Click For Summary
SUMMARY

The discussion centers on the joint probability model represented by the equation p(a, b, c, d) = p(a|b)p(b|c,d)p(c)p(d). Participants clarify that the right-hand side (RHS) of the equation signifies the product of the conditional probability of a given b, the conditional probability of b given c and d, and the individual probabilities of c and d. The concept of marginalization is also introduced, demonstrating how to simplify calculations involving multiple variables. This foundational understanding is crucial for interpreting joint probability models in statistical analysis.

PREREQUISITES
  • Understanding of joint probability distributions
  • Familiarity with conditional probability
  • Knowledge of marginalization techniques in probability
  • Basic concepts of random variables
NEXT STEPS
  • Study the derivation of joint probability models in statistical literature
  • Learn about marginalization in probability theory
  • Explore applications of joint probability in machine learning
  • Review conditional probability examples and exercises
USEFUL FOR

Statisticians, data scientists, and anyone involved in probabilistic modeling or machine learning who seeks to deepen their understanding of joint probability models and their applications.

pamparana
Messages
123
Reaction score
0
Hello everyone,

I am trying to understand a paper and am stuck at one place.

The statement says something as follows:

Say we have a, b, c and d which are random variables generated by some model. This leads to the following joint probability model:

p(a, b, c, d) = p(a|b)p(b|c,d)p(c)p(d)

I do not understand the RHS of the equation at all? What is it saying and quite confused as to how it is derived?

Would be very grateful for any help you can give me.

Thanks,
Luca
 
Physics news on Phys.org
pamparana said:
Say we have a, b, c and d which are random variables generated by some model. This leads to the following joint probability model:

p(a, b, c, d) = p(a|b)p(b|c,d)p(c)p(d)

I do not understand the RHS of the equation at all? What is it saying and quite confused as to how it is derived?
Luca

probability of (a conditional on b) times probability of (b conditional on c,d) times the joint probability of c and d.

You say "some model" If they provided no further information, take it as a given. Conditioning on c,d and multiplying by the joint probability are two different operations.

EDIT: In calculating for conditioning on two or more variables, you try to marginalize one of the variables:

P(A|B,C)=P(A,B,C)/P(B,C)=P(A,B,C)/P(B)P(C|B)=P(C|AB)P(A,B)/P(B)P(C|B)=P(A)P(B|A)P(C|AB)/P(B)PC|B).

This is less complicated then your example with four variables, but it shows the concept of marginalization of P(B) and P(C).
 
Last edited:

Similar threads

  • · Replies 1 ·
Replies
1
Views
3K
  • · Replies 1 ·
Replies
1
Views
3K
Replies
10
Views
1K
Replies
3
Views
3K
  • · Replies 14 ·
Replies
14
Views
3K
  • · Replies 3 ·
Replies
3
Views
5K
Replies
5
Views
2K
  • · Replies 2 ·
Replies
2
Views
4K
  • · Replies 6 ·
Replies
6
Views
2K
  • · Replies 2 ·
Replies
2
Views
1K