Given the pdf of Z = X+Y, what's the pdf of X if X&Y are IID

  • Context: Graduate 
  • Thread starter Thread starter ecneicScience
  • Start date Start date
  • Tags Tags
    Pdf
Click For Summary

Discussion Overview

The discussion revolves around the problem of determining the probability density function (pdf) of a random variable X, given that Z = X + Y has a known pdf and that X and Y are independent and identically distributed (IID). Participants explore various methods and theoretical approaches to tackle this deconvolution problem.

Discussion Character

  • Exploratory
  • Technical explanation
  • Mathematical reasoning
  • Debate/contested

Main Points Raised

  • One participant introduces the problem of finding the pdf of X given the pdf of Z and the IID condition, suggesting the need for a deconvolution operator.
  • Another participant proposes using the Fourier transform to solve the problem, noting that knowing Z with arbitrary precision could facilitate this approach.
  • It is mentioned that calculating all moments of the distribution could help reconstruct the pdf, with some participants discussing the relationship between the moments of Z and X.
  • Concerns are raised about the feasibility of reconstructing the function from moments, with one participant suggesting that it may depend on the nature of the distribution.
  • Participants discuss the potential issues with high frequencies in discretized versions of the pdf and ways to suppress them.
  • A request is made for a theorem that describes the process of constructing a pdf from its moments, leading to references to external resources like Wikipedia.
  • One participant expresses difficulty understanding the reconstruction of a pdf from its moments, specifically regarding the approximation as a polynomial based on moments.
  • A final post suggests considering the problem in terms of computing the probability of X and Y, framing it as their union.

Areas of Agreement / Disagreement

Participants express a range of views on the methods for reconstructing the pdf of X, with some advocating for the use of Fourier transforms and moments, while others question the assumptions and feasibility of these approaches. The discussion remains unresolved, with no consensus on a definitive method or solution.

Contextual Notes

Participants note potential limitations related to the assumptions about the distributions involved and the challenges posed by discretization and high-frequency components in the reconstruction process.

ecneicScience
Messages
8
Reaction score
2
A common problem in statistics is, "Given that X is distributed according to the pdf f(x) and Y is distributed according to the pdf g(y), what is the pdf h(z) of Z = X + Y?" The answer is the convolution of f(x) and g(y):

$$ h(z)=(f*g)(z)=\int_{-\infty}^\infty f(z-t)g(t) dt = \int_{-\infty}^\infty f(t)g(z-t) dt $$

In my research I have stumbled across the reverse problem given that X and Y are IID (identically and independently distributed): "Given that the random variable Z = X+Y has a known pdf h(z), what is the pdf f(x) if it is known that X and Y are IID?"

Does anyone have insight to how this problem could be solved? Is there such a thing as a deconvolution operator that could help me? Thanks in advance.
 
Physics news on Phys.org
If you know Z with arbitrary precision, a Fourier transform should help.
Or calculate all the moments of the distribution.
 
  • Like
Likes   Reactions: ecneicScience
mfb said:
If you know Z with arbitrary precision, a Fourier transform should help.
Or calculate all the moments of the distribution.

Exactly! I never actually thought I'd use those convolution theorems I learned in my FT class!

We know
$$ h = f*g $$
Taking the Fourier transform
$$ \mathcal{F}\{f*g\} = \mathcal{F}\{f\} \cdot \mathcal{F}\{g\} $$
We know f = g, so
$$ \mathcal{F}\{f*g\} = \mathcal{F}\{f\}^2 $$
Rearranging,
$$ f = \mathcal{F}^{-1} \bigg\{ \sqrt{ \mathcal{F} \{ f*g \} } \bigg\} $$
Putting in h,
$$ f = \mathcal{F}^{-1} \bigg\{ \sqrt{ \mathcal{F} \{ h \} } \bigg\} $$

Thank you for that insight. Hopefully my data is not too sparse so that I can perform a decent FFT.

Could you please elaborate how calculating moments could help?
 
If you know all moments, you can reconstruct the function, and you can find relations between the moments of Z and X.

A discretized version can always have problems with high frequencies, but I guess there are ways to suppress them.
 
  • Like
Likes   Reactions: ecneicScience
mfb said:
If you know all moments, you can reconstruct the function

That is not necessarily true. But I guess you can assume that the distribution of the OP is nice enough for it to be true.
 
  • Like
Likes   Reactions: ecneicScience
For all functions where you have some chance to reconstruct it experimentally ;).
 
  • Like
Likes   Reactions: ecneicScience
mfb said:
If you know all moments, you can reconstruct the function, and you can find relations between the moments of Z and X.

A discretized version can always have problems with high frequencies, but I guess there are ways to suppress them.

Is there a theorem you could refer me to that describes this process of constructing a pdf from its moments?
 
mfb said:

That article didn't seem that helpful or it went way over my head. What I had in mind when you said a pdf could be reconstructed from its moments, is that the pdf could be approximated as some polynomial, where each term is somehow a function of the first N moments, and that the reconstruction of became increasingly accurate with increasing N. I couldn't find anything that mentioned this in that article.
 
  • #10
The references given there might help.

Checking Wikipedia, the references given there, and google results with similar keywords is really not magic, and something that could be expected before asking questions.[/size]
 
  • #11
mfb said:
Checking Wikipedia, the references given there, and google results with similar keywords is really not magic, and something that could be expected before asking questions.

Thanks for the tip.
 
  • #12
Can you just look at this as computing the probability of X and Y, eg their union?
 

Similar threads

  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 5 ·
Replies
5
Views
3K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 5 ·
Replies
5
Views
8K
  • · Replies 1 ·
Replies
1
Views
3K
  • · Replies 9 ·
Replies
9
Views
3K
  • · Replies 1 ·
Replies
1
Views
2K
Replies
8
Views
2K
  • · Replies 8 ·
Replies
8
Views
1K
  • · Replies 1 ·
Replies
1
Views
2K