Why Covariance Matrix of Complex Random Vector is Hermitian Positive Definite

Click For Summary
SUMMARY

The covariance matrix of a complex random vector is definitively Hermitian positive definite, as established by its mathematical properties. This conclusion arises from the definition of Hermitian matrices and the characteristics of covariance matrices, which ensure that they are always positive definite. The discussion also highlights that while every real symmetric matrix is Hermitian, the isomorphism between complex and real representations holds primarily for Gaussian random variables. However, this does not extend to crosscovariance matrices, which lack the constraints necessary for positive semidefiniteness.

PREREQUISITES
  • Understanding of Hermitian matrices
  • Knowledge of covariance matrices and their properties
  • Familiarity with complex random vectors
  • Basic concepts of Gaussian random variables
NEXT STEPS
  • Study the properties of Hermitian matrices in detail
  • Research the characteristics of covariance matrices for complex random vectors
  • Examine the implications of positive definiteness in statistical theory
  • Investigate the behavior of crosscovariance matrices in various contexts
USEFUL FOR

Mathematicians, statisticians, data scientists, and researchers working with complex random variables and covariance structures.

fcastillo
Messages
2
Reaction score
0
I've been reading everywhere, including wikipedia, and I can't seem to find a prove to the fact that the covariance matrix of a complex random vector is Hermitian positive definitive. Why is it definitive and not just simple semi-definitive like any other covariance matrix?
Wikipedia just states this and never provides with a prove. Some people might say that it follows from the definition and that a prove is trivial, but I just can't seem to find why. Even if the prove is trivial (and it's eluding me) can somebody please demonstrate why?

Also, if this is true, does it also apply for crosscovariance matrix? (between two different complex random vectors)
 
Physics news on Phys.org
Every real symmetric matrix is Hermitian and there is a complex to real isomorphism for Gaussian RVs. I believe this arises from the definition of Hermitian matrices. I'm not sure if the isomorphism holds for the covariance matrix of non-Gaussian RVs.

http://www.ee.ic.ac.uk/hp/staff/dmb/matrix/expect.html
 
Last edited:
SW VandeCarr said:
Every real symmetric matrix is Hermitian and there is a complex to real isomorphism for Gaussian RVs. I believe this arises from the definition of Hermitian matrices. I'm not sure if the isomorphism holds for the covariance matrix of non-Gaussian RVs.

http://www.ee.ic.ac.uk/hp/staff/dmb/matrix/expect.html

Thanks for the reply, in that post it states that the matrix is positive semi-definite. And the reference I found somewhere else said that the covariance matrix is always positive-definite. Thanks a lot for your reply!
 
fcastillo said:
Thanks for the reply, in that post it states that the matrix is positive semi-definite. And the reference I found somewhere else said that the covariance matrix is always positive-definite. Thanks a lot for your reply!

Sorry, for some reason the wrong link came up. I've got one that answers your question re covariance matrices.

http://www.riskglossary.com/link/positive_definite_matrix.htm
 
Last edited by a moderator:
fcastillo said:
Also, if this is true, does it also apply for crosscovariance matrix? (between two different complex random vectors)

There are no constraints on the elements of a crosscovariance matrix, so it is clearly not necessarily positive semidefinite (or even square in shape!)
 
If there are an infinite number of natural numbers, and an infinite number of fractions in between any two natural numbers, and an infinite number of fractions in between any two of those fractions, and an infinite number of fractions in between any two of those fractions, and an infinite number of fractions in between any two of those fractions, and... then that must mean that there are not only infinite infinities, but an infinite number of those infinities. and an infinite number of those...

Similar threads

  • · Replies 3 ·
Replies
3
Views
3K
  • · Replies 5 ·
Replies
5
Views
5K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 9 ·
Replies
9
Views
18K
  • · Replies 2 ·
Replies
2
Views
3K
  • · Replies 31 ·
2
Replies
31
Views
4K
Replies
1
Views
3K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 14 ·
Replies
14
Views
14K
  • · Replies 8 ·
Replies
8
Views
3K