Deriving the standard normal distribution

Click For Summary

Discussion Overview

The discussion revolves around deriving the standard normal distribution, exploring the relationships between joint distributions of random variables in different coordinate systems (Cartesian, polar, spherical) and the constants involved in these distributions. The scope includes theoretical derivations and mathematical reasoning related to probability density functions (PDFs).

Discussion Character

  • Technical explanation
  • Mathematical reasoning
  • Debate/contested

Main Points Raised

  • One participant calculates the joint distribution of random variables X and Y and derives a constant C for the normal distribution based on transformations to polar coordinates.
  • Another participant suggests that the constant C can be derived directly from the properties of the normal distribution, indicating a missing factor in the original calculation.
  • A participant questions whether it is possible to derive the standard normal distribution using only basic concepts such as the Jacobian and joint distributions without invoking mean and variance.
  • Another participant describes the n-dimensional standard normal distribution as the product of independent 1-dimensional standard normal variables, providing a formula for its probability density function.

Areas of Agreement / Disagreement

Participants express differing views on the methods for deriving the constant C and the standard normal distribution. There is no consensus on the best approach, and some questions remain unresolved regarding the derivation process.

Contextual Notes

Some assumptions about the distributions and transformations may not be fully articulated, and the discussion includes various interpretations of the relationships between different coordinate systems and their implications for the derived constants.

rabbed
Messages
241
Reaction score
3
I've calculated the joint distribution, XY_PDF(x,y) of random
variables X and Y (both coming from a distribution N(n) = C*e^(-K*n^2)).

I use XY_PDF(x,y) to calculate the joint distribution AR_PDF(a,r)
of the random variables A (angle) and R (radius), with the PDF
method and the Jacobian.

Since AR_PDF(a,r) = A_PDF(a)*R_PDF(r) and I want A_PDF(a) = 1/(2*pi),
I can find that C = 1/(2*pi)^(1/2) in N(n), since the other factors in
AR_PDF(a,r) calculated from XY_PDF(x,y) are related to R.

If I do the same in 3D (using the longitude/latitude/radius distributions
for producing a uniform surface distribution), I get C = 1/(2*pi)^(1/3)
after discarding the factors related to the longitude distribution and the
radius distribution.

The correct answer (for a multivariate gaussian) should be 1/(2*pi)^(1/2)
here also, right?

Is my reasoning to find this constant C wrong? Is there a better way?
 
Last edited:
Physics news on Phys.org
You don't need to perform the Cartesian to Polar transformation to calculate C. Just observe that the pdf N is that of a normal random variable with zero mean and variance ##\sigma^2=\frac{1}{2K}##. Then use the formula for a normal distribution to conclude that
$$C=\frac{1}{\sigma\sqrt{2\pi}}=\sqrt\frac{2K}{2\pi}$$
The formula you calculated above is missing the factor ##\sqrt{2K}##.
 
Is there no way to derive the standard normal distribution (not the normal distribution with concepts like mean and variance) from just basic knowledge of:
- The Jacobian
- How to calculate one joint distribution from another joint distribution using the PDF method
- Random vectors in 2D/3D (deriving the distributions of independent variables (polar/spherical coordinates) to get a uniform surface distribution by calculating the joint distribution of their dependent cartesian coordinates)
- Isotropy, wanting another kind of random vector by letting the cartesian coordinates be independent by coming from the same unknown distribution, N, as the radius
 
For a standard normal distribution in n dimensional Euclidean space Rn, I like to think of it just as the joint distribution of n independent 1-dimensional standard normal random variables. As such, its n-dimensional probability density function is just the product

(1/√(2π)) e-x12/2 ⋅ ... ⋅ (1/√(2π)) e-xn2/2

which is

(2π)-n/2 e-(x12 + ... + xn2)/2

or in other words

(2π)-n/2 e-r2/2,

where r is the distance from the origin in Euclidean n-space Rn.

I know this doesn't answer all parts of your question, but it's one easy way to remember the constant factor occurring in the n-dimensional standard normal density.
 
Thanks, zinq
 

Similar threads

  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 8 ·
Replies
8
Views
2K
  • · Replies 2 ·
Replies
2
Views
2K
Replies
1
Views
4K
  • · Replies 1 ·
Replies
1
Views
2K
Replies
5
Views
6K
  • · Replies 25 ·
Replies
25
Views
3K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 11 ·
Replies
11
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K