Convolution Method for Finding Density Functions with Independent Variables

  • Context: Graduate 
  • Thread starter Thread starter gnome
  • Start date Start date
  • Tags Tags
    Convolution
Click For Summary

Discussion Overview

The discussion revolves around the convolution method for finding density functions when combining independent random variables, specifically focusing on the case where one variable is scaled (Z = 2X + Y). Participants explore the application of convolution and transformations to derive the density function for the new variable Z.

Discussion Character

  • Exploratory
  • Technical explanation
  • Mathematical reasoning
  • Debate/contested

Main Points Raised

  • One participant presents the convolution of two independent density functions and derives the density function for Z = X + Y.
  • Another participant attempts to apply a transformation to find the density function for Z = 2X + Y, using a Jacobian approach, but encounters discrepancies in the resulting intervals and values.
  • Some participants clarify that the convolution method is applicable only for sums of independent variables and suggest finding the distribution of 2X first.
  • There is a discussion on how to correctly express the distribution of 2X, with differing interpretations of the transformation and its implications for the density function.
  • A later reply confirms the correct approach to find the distribution of W = 2X, leading to a successful convolution result that aligns with expectations.

Areas of Agreement / Disagreement

Participants express differing views on the correct application of convolution and transformations, leading to unresolved discrepancies in the derived density functions. There is no consensus on the best method to approach the problem initially, though some clarity is achieved later in the discussion.

Contextual Notes

Limitations include potential misunderstandings in the transformation of variables and the application of convolution, as well as the dependence on the specific definitions of the density functions involved.

Who May Find This Useful

Readers interested in probability theory, particularly in the context of convolution methods and transformations of random variables, may find this discussion relevant.

gnome
Messages
1,031
Reaction score
1
Given two independent variables with these simple density functions:

[tex]f(x) = \left\lbrace \begin{array}{ll}<br /> \frac{1}{2} &\mbox{ if } 0 < x < 2 \\<br /> 0 &\mbox{otherwise}<br /> \end{array} \right.[/tex]

[tex]g(y) = \left\lbrace \begin{array}{ll}<br /> \frac{1}{3} &\mbox{ if } 1 < y < 4 \\<br /> 0 &\mbox{otherwise}<br /> \end{array} \right.[/tex]

if Z = X + Y, we can easily find the density function h(z) by the convolution of f and g, so for example
[tex]\int_{-\infty}^{\infty}f(z-t)g(t)dt = \int_{0}^{2}f(z-t)\cdot \frac{1}{2}dt = \frac{1}{2} \int_{z-2}^{z}f(u)du = \frac{1}{6} \int_{z-2}^{z}du[/tex]

and since g lives on (1, 4) and the integration interval has length 2, in the first nonzero interval of the convolution, which is [itex]1 \leq z \leq 3[/itex]
this becomes
[tex]h(z) = \frac{1}{6} \int_{1}^{z}du = \frac{z-1}{6}[/tex]


Now suppose instead that Z = 2X + Y.

Intuition tells me that there should be some change of variables to let me use convolution to derive a density function for this new Z, but if there is I can't find it. I have solved for the density function of this "new'' Z by finding its distribution function and then differentiating. This function has its first nonzero interval on [itex]1 \leq z \leq 4[/itex], and for this interval the differentiation method gives me
[tex]h(z) = \frac{z-1}{12}[/tex].
I'm pretty sure about this answer; I get the same result whichever direction I integrate.

Is there a way to use a convolution to obtain this result?
 
Last edited:
Physics news on Phys.org
So far all I can see is this:
I let
Z = 2X + Y and (arbitrarily) T = X giving me
X = T and Y = Z - 2T
now the Jacobian of this transformation is
[tex]\begin{array}{ll}<br /> J &= \left |\begin{array}{ll}<br /> \frac{\partial {x}}{\partial{z}} = 0 &\frac{\partial{x}} {\partial{t}} = 1 \\<br /> \frac{\partial{y}} {\partial{z}} = 1 &\frac{\partial{y}} {\partial{t}} = -2<br /> \end{array} \right | \\<br /> \\<br /> &= -1<br /> \end{array}[/tex]

so |J| = 1.

X and Y are independent so their joint density function [itex]j_1(x,y) = f(x) \cdot g(y)[/itex]
and I should be able to write
[tex]j_2(t,z) = j_1(x,y)|J| = j_1(t, z-2 t) = f(t) \cdot g(z-2t)[/tex]
and then the marginal density function of z is
[tex]\begin{align*}<br /> m(z) &= \int_{-\infty}^{\infty} f(t) \cdot g(z-2t)dt \\<br /> &= \frac{1}{2} \int_0^2 g(z-2t)dt\\<br /> &= \frac{1}{2} \int_z^{z-4} g(u)\cdot (-\frac{1}{2}du)\\<br /> &= \frac{1}{4} \int_{z-4}^{z} g(u)du\\<br /> &= \frac{1}{12} \int_{z-4}^z du<br /> \end{align*}[/tex]
But since f is on the interval (0,2) while this interval of integration is length 4, the first non-zero interval of the result is
[tex]h(z)= \frac{1}{12} \int_0^z du = \frac{z}{12} \mbox{ when } 0 < z < 2[/tex]

but the correct result based on differentiating the distribution function for this interval was
[tex]h(z) = \frac{z-1}{12} \mbox{ when } 1 < z < 4[/tex]
so both the interval and the value of z are wrong.

Can anyone spot where my error is?
 
Convolution method only works for a sum. You'd need to find the distribution of 2X before you use it.
 
Exactly what do you mean by that (the "distribution of 2X")? X is a continuous random variable. 2X is a function of X.

The probability density of X is
[tex]f(x) = \left\lbrace \begin{array}{ll}<br /> \frac{1}{2} &\mbox{ if } 0 < x < 2 \\<br /> 0 &\mbox{otherwise}<br /> \end{array} \right.[/tex]

Given that, is it valid to say that the distribution of 2X is
[tex]f(2x) = \left\lbrace \begin{array}{ll}<br /> \frac{1}{2} &\mbox{ if } 0 < x < 1 \\<br /> 0 &\mbox{otherwise}<br /> \end{array} \right.[/tex]

or (considering "2x" as a name rather than 2 times x):
[tex]f(2x) = \left\lbrace \begin{array}{ll}<br /> \frac{1}{2} &\mbox{ if } 1 < 2x < 2 \\<br /> 0 &\mbox{otherwise}<br /> \end{array} \right.[/tex]

I worked out the convolutions under both of these approaches (only for the first non-zero interval of each) and I got, for the former,
[tex]h(z) = \frac{z}{12} \mbox{ when } 0 < z < 1[/tex]
and for the latter,
[tex]h(z) = \frac{z-2 }{6} \mbox{ when } 2< z < 3[/tex]

so that doesn't work either, unless you had something else in mind.
 
Last edited:
2x is a variable whose distribution depends on the distribution of x.

[tex]f_{(2x)}(2x)=\frac{1}{4}I_{(0,4)}[/tex]

You should verify this by either the distribution method or using jacobian transformations.
 
Great! That's clear now:

I'll let [itex]W = 2X[/itex]. Then [itex]X = \frac{1}{2}W \mbox{, and } \frac{dX}{dW} = \frac{1}{2}[/itex]
so
[tex]f_W(w) = f_X(x)\frac{dX}{dW} = \frac{1}{2}f_x(x)[/tex]
and when X = 0, W = 0 and when X = 2, W = 4 so
[tex]f_W(w) = \frac{1}{2}f_X(x) = \left\lbrace \begin{array}{ll}<br /> \frac{1}{4} &\mbox{ if } 0 < w < 4 \\<br /> 0 &\mbox{ otherwise} \end{array} \right.[/tex]


and the result of the convolution is now the exact value and interval that I expected. Thanks ZioX.
 
Last edited:

Similar threads

  • · Replies 6 ·
Replies
6
Views
5K
  • · Replies 12 ·
Replies
12
Views
4K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 9 ·
Replies
9
Views
3K
  • · Replies 11 ·
Replies
11
Views
2K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 9 ·
Replies
9
Views
3K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K