Convolution Method for Finding Density Functions with Independent Variables

In summary, we can use convolution to find the density function of a new variable Z, which is a sum of two independent variables X and Y with known density functions. However, if Z is a multiple of X, we need to first find the distribution of X before using convolution, as the distribution of Z will depend on the distribution of X. Using this method, we can find the correct density function for Z = 2X + Y by finding the distribution of 2X and then using convolution.
  • #1
gnome
1,041
1
Given two independent variables with these simple density functions:

[tex]f(x) = \left\lbrace \begin{array}{ll}
\frac{1}{2} &\mbox{ if } 0 < x < 2 \\
0 &\mbox{otherwise}
\end{array} \right. [/tex]

[tex]g(y) = \left\lbrace \begin{array}{ll}
\frac{1}{3} &\mbox{ if } 1 < y < 4 \\
0 &\mbox{otherwise}
\end{array} \right. [/tex]

if Z = X + Y, we can easily find the density function h(z) by the convolution of f and g, so for example
[tex]\int_{-\infty}^{\infty}f(z-t)g(t)dt = \int_{0}^{2}f(z-t)\cdot \frac{1}{2}dt = \frac{1}{2} \int_{z-2}^{z}f(u)du = \frac{1}{6} \int_{z-2}^{z}du[/tex]

and since g lives on (1, 4) and the integration interval has length 2, in the first nonzero interval of the convolution, which is [itex]1 \leq z \leq 3[/itex]
this becomes
[tex]h(z) = \frac{1}{6} \int_{1}^{z}du = \frac{z-1}{6}[/tex]


Now suppose instead that Z = 2X + Y.

Intuition tells me that there should be some change of variables to let me use convolution to derive a density function for this new Z, but if there is I can't find it. I have solved for the density function of this "new'' Z by finding its distribution function and then differentiating. This function has its first nonzero interval on [itex]1 \leq z \leq 4[/itex], and for this interval the differentiation method gives me
[tex]h(z) = \frac{z-1}{12}[/tex].
I'm pretty sure about this answer; I get the same result whichever direction I integrate.

Is there a way to use a convolution to obtain this result?
 
Last edited:
Physics news on Phys.org
  • #2
So far all I can see is this:
I let
Z = 2X + Y and (arbitrarily) T = X giving me
X = T and Y = Z - 2T
now the Jacobian of this transformation is
[tex]\begin{array}{ll}
J &= \left |\begin{array}{ll}
\frac{\partial {x}}{\partial{z}} = 0 &\frac{\partial{x}} {\partial{t}} = 1 \\
\frac{\partial{y}} {\partial{z}} = 1 &\frac{\partial{y}} {\partial{t}} = -2
\end{array} \right | \\
\\
&= -1
\end{array}[/tex]

so |J| = 1.

X and Y are independent so their joint density function [itex]j_1(x,y) = f(x) \cdot g(y)[/itex]
and I should be able to write
[tex]j_2(t,z) = j_1(x,y)|J| = j_1(t, z-2 t) = f(t) \cdot g(z-2t)[/tex]
and then the marginal density function of z is
[tex]\begin{align*}
m(z) &= \int_{-\infty}^{\infty} f(t) \cdot g(z-2t)dt \\
&= \frac{1}{2} \int_0^2 g(z-2t)dt\\
&= \frac{1}{2} \int_z^{z-4} g(u)\cdot (-\frac{1}{2}du)\\
&= \frac{1}{4} \int_{z-4}^{z} g(u)du\\
&= \frac{1}{12} \int_{z-4}^z du
\end{align*}
[/tex]
But since f is on the interval (0,2) while this interval of integration is length 4, the first non-zero interval of the result is
[tex]h(z)= \frac{1}{12} \int_0^z du = \frac{z}{12} \mbox{ when } 0 < z < 2[/tex]

but the correct result based on differentiating the distribution function for this interval was
[tex]h(z) = \frac{z-1}{12} \mbox{ when } 1 < z < 4[/tex]
so both the interval and the value of z are wrong.

Can anyone spot where my error is?
 
  • #3
Convolution method only works for a sum. You'd need to find the distribution of 2X before you use it.
 
  • #4
Exactly what do you mean by that (the "distribution of 2X")? X is a continuous random variable. 2X is a function of X.

The probability density of X is
[tex]f(x) = \left\lbrace \begin{array}{ll}
\frac{1}{2} &\mbox{ if } 0 < x < 2 \\
0 &\mbox{otherwise}
\end{array} \right. [/tex]

Given that, is it valid to say that the distribution of 2X is
[tex]f(2x) = \left\lbrace \begin{array}{ll}
\frac{1}{2} &\mbox{ if } 0 < x < 1 \\
0 &\mbox{otherwise}
\end{array} \right. [/tex]

or (considering "2x" as a name rather than 2 times x):
[tex]f(2x) = \left\lbrace \begin{array}{ll}
\frac{1}{2} &\mbox{ if } 1 < 2x < 2 \\
0 &\mbox{otherwise}
\end{array} \right. [/tex]

I worked out the convolutions under both of these approaches (only for the first non-zero interval of each) and I got, for the former,
[tex]h(z) = \frac{z}{12} \mbox{ when } 0 < z < 1[/tex]
and for the latter,
[tex]h(z) = \frac{z-2 }{6} \mbox{ when } 2< z < 3[/tex]

so that doesn't work either, unless you had something else in mind.
 
Last edited:
  • #5
2x is a variable whose distribution depends on the distribution of x.

[tex]f_{(2x)}(2x)=\frac{1}{4}I_{(0,4)}[/tex]

You should verify this by either the distribution method or using jacobian transformations.
 
  • #6
Great! That's clear now:

I'll let [itex]W = 2X[/itex]. Then [itex]X = \frac{1}{2}W \mbox{, and } \frac{dX}{dW} = \frac{1}{2}[/itex]
so
[tex]f_W(w) = f_X(x)\frac{dX}{dW} = \frac{1}{2}f_x(x)[/tex]
and when X = 0, W = 0 and when X = 2, W = 4 so
[tex]f_W(w) = \frac{1}{2}f_X(x) = \left\lbrace \begin{array}{ll}
\frac{1}{4} &\mbox{ if } 0 < w < 4 \\
0 &\mbox{ otherwise} \end{array} \right.
[/tex]


and the result of the convolution is now the exact value and interval that I expected. Thanks ZioX.
 
Last edited:

1. What is the definition of a convolution math problem?

A convolution math problem is a mathematical operation that combines two functions to produce a third function. It is often used in signal processing, image processing, and other fields of science and engineering.

2. How is a convolution math problem different from other mathematical operations?

Unlike other mathematical operations that use arithmetic rules, a convolution math problem involves integrating two functions to create a new function. This makes it a more complex and powerful tool for analyzing and manipulating data.

3. What are the main applications of convolution in science?

Convolution is commonly used in fields such as signal processing, image processing, and digital filtering. It is also used in physics, chemistry, and other sciences to model and analyze processes that involve the combination of multiple inputs.

4. Can you provide an example of a convolution math problem?

One example of a convolution math problem is the calculation of the response of a system to an input signal. This involves convolving the input signal with the impulse response of the system to determine the output signal.

5. How can convolution be visualized or represented graphically?

Convolution can be represented graphically as a sliding window operation, where one function is shifted over the other to calculate the integral at each point. It can also be visualized using diagrams or animations to show how the two functions are combined to produce the third function.

Similar threads

  • Set Theory, Logic, Probability, Statistics
Replies
6
Views
4K
  • Set Theory, Logic, Probability, Statistics
Replies
1
Views
1K
  • Set Theory, Logic, Probability, Statistics
Replies
12
Views
3K
  • Set Theory, Logic, Probability, Statistics
Replies
9
Views
2K
  • Set Theory, Logic, Probability, Statistics
Replies
1
Views
745
  • Set Theory, Logic, Probability, Statistics
Replies
2
Views
1K
  • Set Theory, Logic, Probability, Statistics
Replies
4
Views
2K
  • Set Theory, Logic, Probability, Statistics
Replies
4
Views
819
  • Set Theory, Logic, Probability, Statistics
Replies
9
Views
2K
Replies
0
Views
354
Back
Top