Convolution Method for Finding Density Functions with Independent Variables

  • Thread starter Thread starter gnome
  • Start date Start date
  • Tags Tags
    Convolution
Click For Summary
The discussion revolves around using convolution to find the density function for a new variable Z defined as a linear combination of independent variables X and Y. Initially, the convolution method successfully derived the density function for Z = X + Y, yielding h(z) = (z-1)/6 for 1 ≤ z ≤ 3. However, when Z is defined as Z = 2X + Y, the convolution approach initially led to incorrect intervals and values for the density function. The error was identified in the treatment of the distribution of 2X, which requires a proper transformation to derive the correct density function. Ultimately, using the Jacobian transformation clarified the process, resulting in the expected density function h(z) = (z-1)/12 for 1 < z < 4.
gnome
Messages
1,031
Reaction score
1
Given two independent variables with these simple density functions:

f(x) = \left\lbrace \begin{array}{ll}<br /> \frac{1}{2} &amp;\mbox{ if } 0 &lt; x &lt; 2 \\<br /> 0 &amp;\mbox{otherwise}<br /> \end{array} \right.

g(y) = \left\lbrace \begin{array}{ll}<br /> \frac{1}{3} &amp;\mbox{ if } 1 &lt; y &lt; 4 \\<br /> 0 &amp;\mbox{otherwise}<br /> \end{array} \right.

if Z = X + Y, we can easily find the density function h(z) by the convolution of f and g, so for example
\int_{-\infty}^{\infty}f(z-t)g(t)dt = \int_{0}^{2}f(z-t)\cdot \frac{1}{2}dt = \frac{1}{2} \int_{z-2}^{z}f(u)du = \frac{1}{6} \int_{z-2}^{z}du

and since g lives on (1, 4) and the integration interval has length 2, in the first nonzero interval of the convolution, which is 1 \leq z \leq 3
this becomes
h(z) = \frac{1}{6} \int_{1}^{z}du = \frac{z-1}{6}


Now suppose instead that Z = 2X + Y.

Intuition tells me that there should be some change of variables to let me use convolution to derive a density function for this new Z, but if there is I can't find it. I have solved for the density function of this "new'' Z by finding its distribution function and then differentiating. This function has its first nonzero interval on 1 \leq z \leq 4, and for this interval the differentiation method gives me
h(z) = \frac{z-1}{12}.
I'm pretty sure about this answer; I get the same result whichever direction I integrate.

Is there a way to use a convolution to obtain this result?
 
Last edited:
Physics news on Phys.org
So far all I can see is this:
I let
Z = 2X + Y and (arbitrarily) T = X giving me
X = T and Y = Z - 2T
now the Jacobian of this transformation is
\begin{array}{ll}<br /> J &amp;= \left |\begin{array}{ll}<br /> \frac{\partial {x}}{\partial{z}} = 0 &amp;\frac{\partial{x}} {\partial{t}} = 1 \\<br /> \frac{\partial{y}} {\partial{z}} = 1 &amp;\frac{\partial{y}} {\partial{t}} = -2<br /> \end{array} \right | \\<br /> \\<br /> &amp;= -1<br /> \end{array}

so |J| = 1.

X and Y are independent so their joint density function j_1(x,y) = f(x) \cdot g(y)
and I should be able to write
j_2(t,z) = j_1(x,y)|J| = j_1(t, z-2 t) = f(t) \cdot g(z-2t)
and then the marginal density function of z is
\begin{align*}<br /> m(z) &amp;= \int_{-\infty}^{\infty} f(t) \cdot g(z-2t)dt \\<br /> &amp;= \frac{1}{2} \int_0^2 g(z-2t)dt\\<br /> &amp;= \frac{1}{2} \int_z^{z-4} g(u)\cdot (-\frac{1}{2}du)\\<br /> &amp;= \frac{1}{4} \int_{z-4}^{z} g(u)du\\<br /> &amp;= \frac{1}{12} \int_{z-4}^z du<br /> \end{align*}<br />
But since f is on the interval (0,2) while this interval of integration is length 4, the first non-zero interval of the result is
h(z)= \frac{1}{12} \int_0^z du = \frac{z}{12} \mbox{ when } 0 &lt; z &lt; 2

but the correct result based on differentiating the distribution function for this interval was
h(z) = \frac{z-1}{12} \mbox{ when } 1 &lt; z &lt; 4
so both the interval and the value of z are wrong.

Can anyone spot where my error is?
 
Convolution method only works for a sum. You'd need to find the distribution of 2X before you use it.
 
Exactly what do you mean by that (the "distribution of 2X")? X is a continuous random variable. 2X is a function of X.

The probability density of X is
f(x) = \left\lbrace \begin{array}{ll}<br /> \frac{1}{2} &amp;\mbox{ if } 0 &lt; x &lt; 2 \\<br /> 0 &amp;\mbox{otherwise}<br /> \end{array} \right.

Given that, is it valid to say that the distribution of 2X is
f(2x) = \left\lbrace \begin{array}{ll}<br /> \frac{1}{2} &amp;\mbox{ if } 0 &lt; x &lt; 1 \\<br /> 0 &amp;\mbox{otherwise}<br /> \end{array} \right.

or (considering "2x" as a name rather than 2 times x):
f(2x) = \left\lbrace \begin{array}{ll}<br /> \frac{1}{2} &amp;\mbox{ if } 1 &lt; 2x &lt; 2 \\<br /> 0 &amp;\mbox{otherwise}<br /> \end{array} \right.

I worked out the convolutions under both of these approaches (only for the first non-zero interval of each) and I got, for the former,
h(z) = \frac{z}{12} \mbox{ when } 0 &lt; z &lt; 1
and for the latter,
h(z) = \frac{z-2 }{6} \mbox{ when } 2&lt; z &lt; 3

so that doesn't work either, unless you had something else in mind.
 
Last edited:
2x is a variable whose distribution depends on the distribution of x.

f_{(2x)}(2x)=\frac{1}{4}I_{(0,4)}

You should verify this by either the distribution method or using jacobian transformations.
 
Great! That's clear now:

I'll let W = 2X. Then X = \frac{1}{2}W \mbox{, and } \frac{dX}{dW} = \frac{1}{2}
so
f_W(w) = f_X(x)\frac{dX}{dW} = \frac{1}{2}f_x(x)
and when X = 0, W = 0 and when X = 2, W = 4 so
f_W(w) = \frac{1}{2}f_X(x) = \left\lbrace \begin{array}{ll}<br /> \frac{1}{4} &amp;\mbox{ if } 0 &lt; w &lt; 4 \\<br /> 0 &amp;\mbox{ otherwise} \end{array} \right.<br />


and the result of the convolution is now the exact value and interval that I expected. Thanks ZioX.
 
Last edited:
The standard _A " operator" maps a Null Hypothesis Ho into a decision set { Do not reject:=1 and reject :=0}. In this sense ( HA)_A , makes no sense. Since H0, HA aren't exhaustive, can we find an alternative operator, _A' , so that ( H_A)_A' makes sense? Isn't Pearson Neyman related to this? Hope I'm making sense. Edit: I was motivated by a superficial similarity of the idea with double transposition of matrices M, with ## (M^{T})^{T}=M##, and just wanted to see if it made sense to talk...

Similar threads

  • · Replies 6 ·
Replies
6
Views
4K
  • · Replies 12 ·
Replies
12
Views
4K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 9 ·
Replies
9
Views
2K
  • · Replies 9 ·
Replies
9
Views
3K
  • · Replies 11 ·
Replies
11
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 4 ·
Replies
4
Views
3K