Joint PDF of two continuous random variables

In summary, the joint probability density function (PDF) of two continuous random variables describes the probability of both variables taking on specific values simultaneously. It can be represented by a two-dimensional graph or equation and is used to analyze the relationship between the two variables. The joint PDF is a fundamental concept in probability and statistics, commonly used in multivariate analysis and modeling. It allows for the calculation of probabilities for any combination of values for the two variables and can provide valuable insights into the behavior and characteristics of a system or phenomenon.
  • #1
Evo8
169
0

Homework Statement



The joint PDF (probability density function) ##p_{X,Y}(x,y)## of two continuous random variables by:
$$ p_{X,Y}= Axy e^{-(x^2)}e^{\frac{-y^2}{2}}u(x)u(y)$$

a) find A
b) Find ##p_X (x), \ p_{y}, \ p_{X|Y}(x|y), and \ p_{Y|X}(y|x)##

Homework Equations



The first coulpe pages of this presentation has some information on this form. http://berlin.csie.ntnu.edu.tw/Courses/Probability/2011Lectures/PROB2011F_Lecture-09-Continuous%20Random%20Variables%20-Conditioning,%20Expectation%20and%20Independence.pdf


The Attempt at a Solution



Im stuck on part A. This is somewhat similar to my last question in a previous thread. I just don't see how to solve for A. My textbook has some examples of very similar form but the contant A is not present. I am not sure why they provide an example one way and then ask questions of a different way. To spark your thinking I guess.

I do know I have to mess around with some double integrals and what not but I need to resolve the unknown constant A first.

Any hints are greatly appreciated!

Thanks!
 
Physics news on Phys.org
  • #2
Ive been rereading the section in my text about joint PDF's.

From my text:
For two RV's x and y, we define CDF ##F_{xy}(x,y)## as follows

$$F_{XY}(x,y)=P(X≤x \ and \ Y≤y)$$

and the joint PDF ##p_{xy}(x,y)=\frac{\delta^{2}}{\delta_{x}\delta_{y}}F_{XY}(x,y)##

Then I see the this which may be relevant:
for observing x from ##-\infty \ to \ \infty##

$$\int_{-\infty}^{\infty}\int_{-\infty}^{\infty}p_{XY}(x,y)dxdy=1$$

In addition there is a section that talks about Rayleigh random variables. I know my problem statement doest not mention Rayleigh but i wasnt sure if maybe it applies here.

A Rayleigh RV can be derived from two independant Gaussiaon RV's as follows. Let x and y be independent Gaussian variables with identical PDF's

$$p_X(x)=\frac{1}{\sigma \sqrt{2 \pi}}e^{-x^2/2 \sigma^2}$$
$$p_Y(y)=\frac{1}{\sigma \sqrt{2 \pi}}e^{-y^2/2 \sigma^2}$$
$$p_{XY}(x,y)=p_{x}(y)p_Yy)= \frac{1}{2 \pi \sigma^2}e^{-(x^2+y^2)/2 \sigma^2}$$

Unfortunately I am still stuck on how to find A. I am 90% certain its something simple and I am just not seeing it...

Thanks again for any help.
 
  • #3
Evo8 said:

Homework Statement



The joint PDF (probability density function) ##p_{X,Y}(x,y)## of two continuous random variables by:
$$ p_{X,Y}= Axy e^{-(x^2)}e^{\frac{-y^2}{2}}u(x)u(y)$$

a) find A
b) Find ##p_X (x), \ p_{y}, \ p_{X|Y}(x|y), and \ p_{Y|X}(y|x)##

Homework Equations



The first coulpe pages of this presentation has some information on this form. http://berlin.csie.ntnu.edu.tw/Courses/Probability/2011Lectures/PROB2011F_Lecture-09-Continuous%20Random%20Variables%20-Conditioning,%20Expectation%20and%20Independence.pdf

The Attempt at a Solution



Im stuck on part A. This is somewhat similar to my last question in a previous thread. I just don't see how to solve for A. My textbook has some examples of very similar form but the contant A is not present. I am not sure why they provide an example one way and then ask questions of a different way. To spark your thinking I guess.

I do know I have to mess around with some double integrals and what not but I need to resolve the unknown constant A first.

Any hints are greatly appreciated!

Thanks!

Hi Evo8! :smile:

To find A you need to use that the total probability is 1.

In other words:

$$\int \int p_{X,Y}dxdy= \int \int Axy e^{-(x^2)}e^{\frac{-y^2}{2}}u(x)u(y)dxdy = 1$$

Can you calculate that integral?
 
Last edited:
  • #4
Hi ILS!

Thanks for your response!

This makes sense. To answer your question on weather or not I can evaluate the integral the answer is not right now. I will do some searching and try to refresh my memory...
 
  • #5
Ok I am stuck on the calculus here... I know this isn't really the calc form but I think only a small hint will get me back on track.

Ive reviewed double integrals and I think I understand/remember this process. I get stuck on evaluating the first integral (integrating the function with respect to x. I think I need to integrate by parts. I have reviewed this process and no problems there if i only had 2 terms to deal with. Here I have four. I haven't seen how I can apply integration by parts successfully to 4 terms.

My first integral I need to evaluate so far is ##A\int xy e^{-(x^2)}e^{\frac{-y^2}{2}} u(x)##'

Am I on the right path here?


EDIT:

So I see how to do integration by parts with 3 terms. You basically group two of the terms together and integrate by parts several times. With 4 terms I image i do the same but have 2 groups of 2 terms and perform an integration on each then back to the original.

Can I rearrange my function like this? ##A\int xe^{-(x^2)} \ ye^{\frac{-y^2}{2}}u(x)##

So I would split the x and y terms up and then have to do integration by parts on each term?
Seems like a lot for something that doesn't look so complicated. Ill try to work through the math in the mean time.

Im just thinking out loud here I guess..

Thanks again for the help
 
Last edited:
  • #6
Evo8 said:
Ok I am stuck on the calculus here... I know this isn't really the calc form but I think only a small hint will get me back on track.

Ive reviewed double integrals and I think I understand/remember this process. I get stuck on evaluating the first integral (integrating the function with respect to x. I think I need to integrate by parts. I have reviewed this process and no problems there if i only had 2 terms to deal with. Here I have four. I haven't seen how I can apply integration by parts successfully to 4 terms.

My first integral I need to evaluate so far is ##A\int xy e^{-(x^2)}e^{\frac{-y^2}{2}} u(x)##'

Am I on the right path here?


EDIT:

So I see how to do integration by parts with 3 terms. You basically group two of the terms together and integrate by parts several times. With 4 terms I image i do the same but have 2 groups of 2 terms and perform an integration on each then back to the original.

Can I rearrange my function like this? ##A\int xe^{-(x^2)} \ ye^{\frac{-y^2}{2}}u(x)##

So I would split the x and y terms up and then have to do integration by parts on each term?
Seems like a lot for something that doesn't look so complicated. Ill try to work through the math in the mean time.

Im just thinking out loud here I guess..

Thanks again for the help

Yes. You can split the integral.

$$\int_{-\infty}^{\infty} \int_{-\infty}^{\infty} Axy e^{-(x^2)}e^{\frac{-y^2}{2}} u(x)u(y)dxdy = A\int_{-\infty}^{\infty} x e^{-(x^2)} u(x) dx \int_{-\infty}^{\infty} ye^{\frac{-y^2}{2}} u(y) dy $$

Now you need to get rid of those u(x) and u(y) first.
After that you can do integration by parts.
 
  • #7
For some reason I was under the impression that the u(x) and u(y) were instead of dx dy. Looking back it makes now sense. I guess I don't see what I can do to "get rid" of them though.. Would I want to move them over to the other side of the equation? I don't see how that would help though..
 
  • #8
You are aware that u(x) is the step function?
It is zero if x<0 and one if x>0.

You can write
$$\int_{-\infty}^{\infty} f(x)u(x)dx = \int_{-\infty}^{0} f(x)u(x)dx + \int_{0}^{\infty} f(x)u(x)dx$$
 
  • #9
I like Serena said:
You are aware that u(x) is the step function?
It is zero if x<0 and one if x>0.

You can write
$$\int_{-\infty}^{\infty} f(x)u(x)dx = \int_{-\infty}^{0} f(x)u(x)dx + \int_{0}^{\infty} f(x)u(x)dx$$

I'm aware now.. hmm I am trying to follow here.

From what you have stated above about the unit step function regarding my u(x) only I have something like this written down

$$\int_{-\infty}^{\infty} xe^{-(x^2)}u(x)dx=\int_0^{\infty} xe^{-(x^2)}u(x)dx \ +0$$

Im fairly confident I am not looking at this correctly though since that doesn't mathematically agree..
 
  • #10
Evo8 said:
I'm aware now.. hmm I am trying to follow here.

From what you have stated above about the unit step function regarding my u(x) only I have something like this written down

$$\int_{-\infty}^{\infty} xe^{-(x^2)}u(x)dx=\int_0^{\infty} xe^{-(x^2)}u(x)dx \ +0$$

Im fairly confident I am not looking at this correctly though since that doesn't mathematically agree..

This is correct. You can also replace the remaining u(x) by 1 now, since x is always positive in the remaining integral.
 
  • #11
hmm ok.

So what I have written down now is:

$$ A \int_0^{\infty}xe^{-(x^2)}dx \int_0^{\infty}ye^{\frac{-y^2}{2}}dy=1$$

So I can now solve for both of those integrals separately using integration by parts and then input the results. Rearrange to solve for A?

I didnt think I could split the double integral up like that though. I thought I had to solve the inner integral and then solve the outter?
 
  • #12
Evo8 said:
hmm ok.

So what I have written down now is:

$$ A \int_0^{\infty}xe^{-(x^2)}dx \int_0^{\infty}ye^{\frac{-y^2}{2}}dy=1$$

So I can now solve for both of those integrals separately using integration by parts and then input the results. Rearrange to solve for A?

I didnt think I could split the double integral up like that though. I thought I had to solve the inner integral and then solve the outter?

In this case you can split it like this.
You can move expressions out of the integral as long as they don't change with respect to the variable that you're integrating.
Note that an integral is really a summation.
It obeys the same rules other summations do.

For instance:
$$Ax_1 + Ax_2 + Ax_3 = A(x_1 + x_2 + x_3)$$
and
$$x_1f(y) + x_2f(y) + x_3f(y) = (x_1 + x_2 + x_3)f(y)$$
So you can move A or f(y) outside.


But:
$$x_1f(x_1) + x_2f(x_2) + x_3f(x_3) \ne (x_1 + x_2 + x_3)f(x)$$
So you cannot move f(x) outside.
 
  • #13
Ok I see why it works for this case. Thanks for breaking it down for me.

Im attempting the integrals now and I am not sure how to "legally" deal with integrating ##e^{-(x^2)}##

I can use my calculator to solve the integrals individually and then evaluate at the limits and end up with

$$A \frac{1}{2} + 1 = 1$$

Solve for A and get ##A=\frac{2}{3}##

If I am correct in my thinking anyway. However id like to gain the understanding and practice of integrating by hand...
 
  • #14
Evo8 said:
Ok I see why it works for this case. Thanks for breaking it down for me.

Im attempting the integrals now and I am not sure how to "legally" deal with integrating ##e^{-(x^2)}##

I can use my calculator to solve the integrals individually and then evaluate at the limits and end up with

$$A \frac{1}{2} + 1 = 1$$

Solve for A and get ##A=\frac{2}{3}##

If I am correct in my thinking anyway. However id like to gain the understanding and practice of integrating by hand...

What's the derivative of ##e^{-x^2}##?
 
  • #15
##\frac{d}{dx}(e^{-x^2})=-2xe^{-x^2}##

Im not sure if this really works but can I get something like this?

$$\int e^{-x^2} = \frac{-1}{2x}e^{-x^2}$$

I don't think that really follows the product rule though..
 
Last edited:
  • #16
Evo8 said:
##\frac{d}{dx}(e^{-x^2})=-2xe^{-x^2}##

Good!

Now perhaps you can use the substitution ##u=e^{-x^2}##?


Or otherwise use ##dv = -2xe^{-x^2}## in integration by parts ##\left( \int u dv = uv - \int v du \right)##?



Im not sure if this really works but can I get something like this?

$$\int e^{-x^2} = \frac{-1}{2x}e^{-x^2}$$

I don't think that really follows the product rule though..

You're right. This does not work. :wink:
 
  • #17
Im not sure i follow where this is supposed to lead.

you mention to use ##dv=-2xe^{-2}## I am ultimately trying to solve the following ## \int e^{-x^2}## for integration by parts using the formula you posted above am I working backwards?
I tried playing with a few different combinations of u and dv and I don't see how it works out.

Wouldn't I be better off by assigning u to be ##u=e^{-x^2}##? since I can find my du. In this case I would assume ##v=1##. However when I try this it doesn't really work out either.

It doesn't seem like a hard integral to solve however i can't find a combination that works. Also after a bunch of research online there are quite a few that say there is not good solution to this. I see where they are coming from but I don't see why...
 
  • #18
There is no solution to ##\int e^{-x^2}dx##, but there is a solution for ##\int xe^{-x^2}dx##.

Let's try substituting ##u=e^{-x^2}##.
Then we also have ##du=-2xe^{-x^2} dx##.

##\int xe^{-x^2}dx = \int -\frac 1 2 \cdot -2xe^{-x^2}dx = \int -\frac 1 2 du = -\frac 1 2 u + C = -\frac 1 2 e^{-x^2} + C##

Taking the derivative of the right hand side confirms that we get the original integral expression.
 
  • #19
Maybe its the algebra hanging me up now.

Once you get ##\int - \frac{1}{2} -2xe^{-x^2} dx## I see how you substitute the du in then integrate ending with a u term then plugging the original back in.

I can't figure out how you get the following ##\int xe^{-x^2} dx=\int -\frac{1}{2}-2xe^{-x^2} dx##

since I have ##du=-2e^{-x^2} dx## I thought maybe you rearranged for x on the left and side giving you the ##\frac{1}{2}## but then you end up with ##x= -\frac{1}{2} \frac{du}{dxe^{-x^2}}##

I also looked at rearranging for dx to give you ##dx=-\frac{1}{2} \frac{du}{xe^{-x^2}}## but That doesn't really work out either, plus there's still an x on the right hand side.

What am I missing here. Something simple no doubt.
 
  • #20
Your problem seems to be that you omitted the multiplication sign.
$$-\frac 1 2 \cdot -2 = 1$$
 
  • #21
ughhh.. yes I see it now.

Thank you for being patient and painfully breaking this down for me.

I do appreciate it! ...on to the next few problems :)
 
  • #22
Just to be sure i fully understand I tried doing the other integral from the original problem involving ##e^{-x^2}##


##u=e^{\frac{-y^2}{2}}##

##\int ye^{\frac{-y^2}{2}}dy##
##=\int (-1)-ye^{\frac{-y^2}{2}}dy##
##=\int (-1)du##
##=-1u=-e^{\frac{-y^2}{2}}##

Anyway. Thanks again!
 
  • #23
Yep! You've got it! :smile:
 

What is a joint PDF of two continuous random variables?

A joint probability density function (PDF) of two continuous random variables is a mathematical function that describes the probability of obtaining a specific combination of values from both variables. It is used to model the joint behavior of two continuous random variables and is often denoted by f(x,y).

How is a joint PDF different from a marginal PDF?

A joint PDF describes the probability of obtaining specific combinations of values from two continuous random variables, while a marginal PDF describes the probability of obtaining a specific value from only one of the variables. In other words, a joint PDF takes into account the relationship between two variables, while a marginal PDF looks at each variable individually.

What is the relationship between a joint PDF and a joint CDF?

A joint CDF (cumulative distribution function) is the integral of a joint PDF. It represents the probability that the two continuous random variables take on values less than or equal to a given pair of values. In other words, the joint CDF is the area under the curve of the joint PDF.

How is a joint PDF used in statistical analysis?

A joint PDF is used in statistical analysis to model the joint behavior of two continuous random variables. It is commonly used in multivariate analysis to understand the relationship between two variables and to make predictions about future outcomes. It can also be used to calculate probabilities and expected values for specific combinations of values from the two variables.

What are some common properties of a joint PDF?

Some common properties of a joint PDF include that it must be a non-negative function, its integral over all possible values must equal 1, and it must be continuous everywhere except at a finite number of points. Additionally, the joint PDF can be used to calculate the probability of events such as a single variable falling within a certain range or the correlation between the two variables.

Similar threads

  • Set Theory, Logic, Probability, Statistics
Replies
3
Views
743
  • Set Theory, Logic, Probability, Statistics
Replies
30
Views
2K
  • Precalculus Mathematics Homework Help
Replies
2
Views
948
  • Set Theory, Logic, Probability, Statistics
Replies
10
Views
1K
  • Set Theory, Logic, Probability, Statistics
Replies
5
Views
480
  • Science and Math Textbooks
Replies
6
Views
831
  • Engineering and Comp Sci Homework Help
Replies
1
Views
1K
  • Set Theory, Logic, Probability, Statistics
Replies
1
Views
1K
  • Calculus and Beyond Homework Help
Replies
2
Views
1K
Replies
3
Views
2K
Back
Top