On pdf of a sum of two r.v.s and differentiating under the integral

  • Context: Undergrad 
  • Thread starter Thread starter psie
  • Start date Start date
  • Tags Tags
    Measure theory
Click For Summary
SUMMARY

The discussion centers on the probability density function (pdf) of the sum of two continuous random variables, denoted as ##X_1## and ##X_2##. It clarifies that while the sum may not always be continuous, the derivation of the pdf remains valid under the assumption that both random variables are real-valued. The derivation utilizes Fubini-Tonelli's theorem and the fundamental theorem of calculus to differentiate the cumulative distribution function, leading to the pdf of the sum, ##f_Y(u) = \int_{\mathbb{R}} f(u-x, x) \, dx##. The discussion emphasizes that the derivation presumes ##Y## to be a continuous random variable.

PREREQUISITES
  • Understanding of continuous random variables and their properties
  • Familiarity with probability measures and expectation
  • Knowledge of Fubini-Tonelli's theorem
  • Proficiency in calculus, specifically the fundamental theorem of calculus
NEXT STEPS
  • Study the implications of the sum of continuous random variables not being continuous
  • Explore Fubini's theorem in greater depth
  • Learn about the Leibniz rule for differentiating under the integral sign
  • Investigate the properties of pushforward measures in probability theory
USEFUL FOR

Mathematicians, statisticians, and students of probability theory who are interested in understanding the behavior of sums of random variables and the derivation of their probability distributions.

psie
Messages
315
Reaction score
40
TL;DR
I'm stuck at a derivation in my book on the pdf of the sum of two continuous random variables ##Y=X_1+X_2##. The formula I'm after is $$f_Y(u)=\int_{\mathbb R} f(x_1,u-x_1)\,dx_1=\int_{\mathbb R} f(u-x_2,x_2)\,dx_2,$$ where ##f## is the joint density of ##(X_1,X_2)##.
I'm reading in my book about the pdf of the sum of two continuous random variables ##X_1,X_2##. First, I'm a bit confused about the fact that the sum of two continuous random variables may not be continuous. Does this fact make the derivation below still valid or is there some key assumption that I'm missing for it to be valid?

Regarding the derivation in my book, I will omit some details, but assume ##X_1,X_2## are both real-valued and ##P## is the probability measure on some probability space. Recall ##\int 1_A \, dP=P(A)## and for a measurable function ##g## such that ##E[|g(X)|]<\infty##, we have $$E[g(X)]=\int_\Omega g(X)\, P(d\omega)=\int_\mathbb{R} g(x) \, P_X(dx)=\int_{\mathbb R}g(x) f(x)dx,$$ where ##P_X## is the induced probability by ##X## (the pushforward measure of ##P## under ##X##). The distribution is then simply given by $$\begin{align}F_{Y}(u)&=P(X_1+X_2\leq u) \nonumber \\ &=E[1_{X_1+X_2\leq u} ] \nonumber \\ &=\int_{\mathbb R^2}1_{x_1+x_2\leq u}f(x_1,x_2)\,dx_1dx_2 \nonumber \\ &=\int_{\mathbb R}\int_{\mathbb R} 1_{x_1\leq u-x_2}f(x_1,x_2)\, dx_1dx_2 \nonumber \\ &=\int_{-\infty}^\infty\int_{-\infty}^{u-x_2}f(x_1,x_2)\,dx_1dx_2. \nonumber \end{align}$$ We used the definition of the expectation and Fubini-Tonelli's theorem. Then the author goes; we differentiate with respect to ##u## and move ##\frac{d}{du}## inside the outer integral and use the fundamental theorem of calculus. However, there is not a lot of motivation given for this maneuver. Why can we do this? I'm familiar with Leibniz rule, but I'm unsure if this applies here.
 
Last edited:
Physics news on Phys.org
I think I found an answer to my question. In the last integral, we make a change of variables: ##z=x_1+x_2## and rename ##x_2=x## (for aesthetics), then $$F_Y(u)=\int_{-\infty}^\infty\int_{-\infty}^{u}f(z-x,x)\,dzdx. $$We change the order of integration and then just use the fundamental theorem of calculus: $$f_Y(u)=\frac{d}{du} F_Y(u)= \frac{d}{du}\int_{-\infty}^u\int_{-\infty}^{\infty}f(z-x,x)\,dxdz= \int_{\mathbb R} f(u-x,x)\,dx.$$
 
Last edited:
I guess regarding my first question, the whole derivation assumes ##Y## to be a continuous random variable, since its density is what we are deriving, i.e. we neglect the cases where the sum of two continuous random variables is not continuous.
 

Similar threads

  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 3 ·
Replies
3
Views
3K
  • · Replies 12 ·
Replies
12
Views
4K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 6 ·
Replies
6
Views
2K
  • · Replies 9 ·
Replies
9
Views
3K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 20 ·
Replies
20
Views
2K
  • · Replies 6 ·
Replies
6
Views
3K