Dismiss Notice
Join Physics Forums Today!
The friendliest, high quality science and math community on the planet! Everyone who loves science is here!

Bivariate normal distribution

  1. Jun 3, 2012 #1
    Quick question on bivariate normal distribution please:

    I know for a bivariate normal distribution, the two variables are marginally normal and all the conditional distributions are also normal.

    Is the reverse true?

    i.e. if you have two random variables that are marginally normal themselves and all the conditional distributions of one variable given a value of the other are also normal, does this result in the joint distribution has to be "bivariate normal" or it can still be another type of joint distribution?

    thanks.
     
  2. jcsd
  3. Jun 3, 2012 #2
    In fact as long as they both are normal (and independent) you are done; the joined distribution will be bivariate normal.
     
    Last edited: Jun 3, 2012
  4. Jun 3, 2012 #3

    mathman

    User Avatar
    Science Advisor
    Gold Member

    Independence is unnecessary.
     
  5. Jun 3, 2012 #4
    I didn't say it is mandatory, but if it is there then you are sure you have a jointly bivariate normal, if it is not then you have to prove it.
     
  6. Jun 3, 2012 #5
    thanks guys, just to be clear,

    even if they are not independent, is the joint distribution has to be bivariate normal?

    no need for proof.
     
  7. Jun 4, 2012 #6
    Well, as I said, if X and Y are normally distributed but not independent, they might be or might be not jointly normally distributed; you need to prove it per each case.
     
  8. Jun 4, 2012 #7
    on top of X and Y are normally distributed but not independent,

    if all the conditional distributions are also normal, does that mean X and Y are definitely jointly normal?
     
  9. Jun 4, 2012 #8
    I don't think so, the moment you are allowed to create dependencies between X and Y you can always look for a freak relationship that breaks the definition of the bivariate jointly distribution.
     
  10. Jun 4, 2012 #9
    thanks,

    so you don't think the fact not only all conditional distributions are normal, X and Y are also marginally normal, this is not enough to restrict the joint distribution to be bivariate normal?
     
  11. Jun 4, 2012 #10
    Nah, I don't think so. The definition of a multivariate normal distribution is not simple, one of the condition it has to follow (among other more complex than this one) is that every linear combination of its components is also normally distributed .

    You could try to further constraint X and Y to behave in such a way that a particular linear combination of their values would not behave normally even if for every particular value of X and Y they do (which is basically what your restriction does). And if that does not work you could still try to mess with the other conditions.
     
  12. Jun 4, 2012 #11
    thanks,

    i don't have the proof, but I think the fact because X and Y are also marginally normal (on top of all conditional distributions are normal), this extra condition does make every linear combination of X and Y normally distributed hence bivariate normal, you don't think that is the case?

    any idea how to proof?
     
  13. Jun 4, 2012 #12
    Mathman do you know who is correct?
     
  14. Jun 4, 2012 #13
    It really looks like that, does it? Your restrictions enforce a good amount of independence between X and Y and make it difficult to find dependencies between X and Y to break the bivariate normality but, anyway, how about this one:

    Imagine that given X=x the variance of the normal conditional distribution of Y is inversely proportional to x, and also imagine that the variance of X condition to Y=y is also inversely proportional to y.

    Now you have X,Y, X|Y=y and Y|X=x following normal distributions, but you are getting in the bivariate distribution a contour line that looks nothing like an ellipse which is what you would expect if it would follow a bivariate joint normal distribution... yeah? I let for you the fun to do the formal proof though :tongue:
     
  15. Jun 4, 2012 #14

    mathman

    User Avatar
    Science Advisor
    Gold Member

    I haven't looked at the question in detail, but my instinct tells me that with all the conditions that are imposed the joint distribution should be normal.

     
  16. Jun 4, 2012 #15
    With the bivariate normal PDF, the variables may be correlated. Jointly normal random variables are uncorrelated and are a special case of the bivariate normal PDF.

    http://athenasc.com/Bivariate-Normal.pdf
     
    Last edited: Jun 4, 2012
  17. Jun 4, 2012 #16
    I've been reading this thread for a couple of days and I also found the above referenced article. As I recall learning once, the missing condition is that the conditional variances must be constant in addition to the conditions given in the original post. I can't find any reference to this and now I'm wondering if it equivalent to the description given in this article or I'm just wrong. Any ideas?
     
  18. Jun 4, 2012 #17
    viraltux, your example doesn't work as it breaks one of the restrictions.
    In your case, as soon as correlation is not zero (the mean of the normal conditional distributions shift), the resultant marginal distribution is no longer normal.

    In fact, the more I think about it, it does seem the only way of keeping marginal distribution of Y normal is for the normal conditional distributions of Y for each value of X follow the bivariate normal formula, with the mean shifting slightly and variance the same.
    As soon as you change the variance of these conditional distributions or shift the mean in a different way, the resultant marginal distribution of Y is no longer normal.

    Therefore I do still think that given the restriction of both X and Y being marginally normal and all conditional distributions being also normal, it does mean that X and Y has to be jointly normal and the joint distribution can not be anything else.

    Would be great if someone can confirm this or convince otherwise.

    Thanks.
     
  19. Jun 5, 2012 #18
    I disagree...

    First, two variables can be correlated and still behave normally, so I am not sure what you mean by "as soon as correlation is not zero... resultant marginal distribution is no longer normal."

    Second, the example I gave results into a symmetric bivariate distribution, if you accept X|Y=y as normal (and it seems you do) you have to accept Y|X=x as normal too.
     
    Last edited: Jun 5, 2012
  20. Jun 5, 2012 #19
    In your example, I believe you are saying the conditional normal distributions having different variance? If that is the case, I don't see how the resultant marginal distribution (from adding all the conditional ones) can still be normal.

    Doesn't the conditional distributions need to have the same variance to be able to add up to a normal distribution?
     
  21. Jun 5, 2012 #20
    Yes, that is what I am saying... The marginal of Y is still normal because I also force the variances of its conditional distributions to change likewise. To understand how the marginal distributions are still normal think about the symmetry of the bivariate distribution.

    You could make up more convoluted examples but in this one you only need to see the symmetry, turn the plot 90º and you'll have exactly the same bivariate plot, so you see, if you have no problem accepting X|Y=y as normal, then you should not have any problem accepting Y|X=x as normal too.
     
Know someone interested in this topic? Share this thread via Reddit, Google+, Twitter, or Facebook