Citation needed: Only multivariate rotationally invariant distribution with iid components is a multivariate normal distribution

  • Context: Undergrad 
  • Thread starter Thread starter DrDu
  • Start date Start date
  • Tags Tags
    Invariant Orthogonal
Click For Summary
SUMMARY

The discussion centers on the proposition that a random vector ##X=(X_1, ..., X_n)^T## with independent and identically distributed (iid) components ##X_i## and mean 0 is only invariant under orthogonal transformations if the distribution of the ##X_i## is a normal distribution. The analysis involves the probability density function (PDF) of ##X##, denoted as f(x_1)...f(x_n), and explores the implications of orthogonal transformations on the function f. The conclusion references the Maxwell characterization of the multivariate normal distribution, specifically citing M. Kac's work published in the American Journal of Mathematics.

PREREQUISITES
  • Understanding of multivariate distributions and their properties
  • Familiarity with orthogonal transformations in linear algebra
  • Knowledge of probability density functions (PDFs) and their characteristics
  • Basic concepts of independent and identically distributed (iid) random variables
NEXT STEPS
  • Study the Maxwell characterization of the multivariate normal distribution
  • Research the implications of orthogonal transformations on probability distributions
  • Explore the properties of probability density functions for iid components
  • Examine M. Kac's paper in the American Journal of Mathematics for deeper insights
USEFUL FOR

Mathematicians, statisticians, and researchers in probability theory, particularly those interested in multivariate normal distributions and their characterizations.

DrDu
Science Advisor
Messages
6,423
Reaction score
1,004
TL;DR
I need a citation for the proposition that the only multivariate rotationally invariant distribution with iid components is a multivariate normal distribution.
I need a citation for the following proposition: Assume a random vector ##X=(X_1, ..., X_n)^T## with iid components ##X_i## and mean 0, then the distribution of ##X## is only invariant with respect to orthogonal transformations, if the distribution of the ##X_i## is a normal distribution.
Thank you for your help!
 
Physics news on Phys.org
The PDF of X is <br /> f(x_1)\dots f(x_n) where f is the PDF of each X_i. Invariance under orthogonal transformations would require f to be even, since the transformation which multiplies the ith component by -1 and fixes the others is orthogonal. We can then write f(z) = g(z^2) whilst g(x_1^2) \cdots g(x_n^2) = F(x^TAx) for some symmetric matrix A which satisfies R^TAR = A for every orthogonal R. This is equivalent to the requiement that A should commute with every orthogonal R. I believe this in fact results in A being a multiple of the identity. If so, we have <br /> g(x_1^2) \cdots g(x_n^2) = F(x_1^2 + \dots + x_n^2) where the multiplier of the identity has been absorbed into F. Setting all but one of the x_i to be zero then shows that <br /> g(x_j^2)g(0)^{n-1} = F(x_j^2). Setting g = Ch where h(0) = 1 we find <br /> F = C^n h where <br /> h(z_1) \cdots h(z_n) = h(z_1 + \dots + z_n) for all (z_1, \dots, z_n) \in [0, \infty)^n. I think now we can proceed by induction on n, noting that for n = 2 and the assumption of continuous h we have h(z) = h(1)^z = \exp(z\log h(1)).
 
Look up the Maxwell characterization of the multivariate normal distribution.
 

Similar threads

  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 5 ·
Replies
5
Views
3K
  • · Replies 6 ·
Replies
6
Views
2K
Replies
1
Views
4K
  • · Replies 11 ·
Replies
11
Views
13K
  • · Replies 25 ·
Replies
25
Views
3K
  • · Replies 6 ·
Replies
6
Views
2K
  • · Replies 7 ·
Replies
7
Views
2K
  • · Replies 4 ·
Replies
4
Views
2K
  • · Replies 5 ·
Replies
5
Views
8K