Minimum conditions for defining joint PDF

Click For Summary
SUMMARY

The discussion focuses on the minimum conditions required for defining a joint probability density function (PDF) p(x,y) given a probability density p(x) and a conditional probability density p(y|x). It establishes that the joint PDF can be expressed as p(x,y) = p(y|x)p(x) and that the double integral P(C) = ∫∫(x,y)∈C p(x,y) dydx is well-defined for measurable subsets C ⊆ X×Y. The conversation highlights that while continuity of p(x,y) is a sufficient condition for changing the order of integration, it is not minimal; measurability of p is essential, as indicated by Fubini's theorem.

PREREQUISITES
  • Understanding of probability density functions (PDFs)
  • Familiarity with conditional probability densities
  • Knowledge of Fubini's theorem
  • Basic calculus, particularly integration techniques
NEXT STEPS
  • Study Fubini's theorem in detail to understand conditions for changing the order of integration
  • Explore examples of joint probability densities involving step functions
  • Learn about measurable functions and their implications in probability theory
  • Investigate continuity conditions for probability density functions
USEFUL FOR

Mathematicians, statisticians, data scientists, and anyone involved in probability theory or statistical modeling will benefit from this discussion.

winterfors
Messages
70
Reaction score
0
Suppose one knows a probability density p(x) over a space X (where x\in X) and a conditional probability density p(y|x) over a space Y (where y\in Y).

This implies the integral \int{p(x)dx} is well defined as well as \int{p(y|x)dy}.

Defining a joint probability density

p(x,y)\ =\ p(y|x)p(x) ,​

p(x) will clearly be its marginal density over X, and the double integral

P(C)\ = \ \iint\limits_{(x,y)\in C}{p(x,y)dydx}​

is well defined for all measurable subsets C\ \subseteq \ X\times Y.One commonly assumes that integrals with reversed order of integration are equivalent

P(C)\ = \ \iint\limits_{(x,y)\in C}{p(x,y)dxdy}\qquad ,​

which also implies that the marginal probability density over Y exists and is uniquely defined p(y)\ = \ \int{p(x,y)dx}.This is not necessarily the case, since the change in order of integration poses restrictions on the integrand p(x,y). One sufficient condition, I believe, is that p(x,y) is continuous, but that is clearly not the minimal condition required. For instance, change of order of integration can be done for a p(x,y) that involves step functions, which are obviously not continuous.

Does anyone know what the minimal conditions are for changing the order of integration, in this case?
 
Last edited:
Physics news on Phys.org
If p>=0 then you just need to know that p is measurable. More generally, if p is measurable then
<br /> \int\int |p(x,y)|dxdy=\int\int |p(x,y)| dydx<br />
and, as long as this is finite then you can commute the integrals in \int\int p(x,y)dxdy. See http://en.wikipedia.org/wiki/Fubini%27s_theorem" .
 
Last edited by a moderator:

Similar threads

  • · Replies 1 ·
Replies
1
Views
3K
  • · Replies 4 ·
Replies
4
Views
3K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 43 ·
2
Replies
43
Views
6K
  • · Replies 7 ·
Replies
7
Views
2K
  • · Replies 1 ·
Replies
1
Views
3K
Replies
4
Views
3K
Replies
2
Views
3K
  • · Replies 1 ·
Replies
1
Views
2K