Real Symmetric Positive Definite Matrices

In summary, the homework statement is trying to find a solution to a system of equations, but doesn't seem to understand how to do it.
  • #1
azdang
84
0

Homework Statement


Let A be a real symmetric positive definite matrix. Show that |aij|<(aii+ajj)/2 for i not equal to j.


Homework Equations





The Attempt at a Solution


I really don't even know where to start with this. I think that aii and ajj must both be > 0 since they are on the diagonal and real symmetric positive definite matrices have positive diagonal elements. Other than this, I honestly have NO ideas. Does anyone else??
 
Physics news on Phys.org
  • #2
Let {ei} be the basis vectors. Then ei*Aei, ej*Aej and (ei+ej)*A(ei+ej) are all positive. What does that mean in terms of the matrix entries of A?
 
Last edited:
  • #3
As with any proof in mathematics, you start by looking at the definitions of the objects in question. Answer the following questions in order. They should help you get started.

1.) What is the definition of a real symmetric matrix?
2.) What is the definition of a positive definite matrix?
3.) Consider a simple case: a 2x2 matrix [itex]A[/itex], given below.

[tex]A = \left[\begin{array}{cc}a_{11} & a_{12}\\a_{21} & a_{22}\end{array}\right][/tex]

Apply the definitions you stated in 1.) and 2.) to say as much as you can about the [itex]a_{ij}[/itex].

4.) Let [itex]\vec{x}^T=\left[x_1,x_2,x_3\right]\in\mathbb{R}^2[/itex]. Apply the definition of a positive definite matrix to [itex]A[/itex] using this vector.

At this point you should be able to deduce the result for the 2x2 case. Hopefully that sheds some light on the subject.
 
Last edited:
  • #4
Thank you for all your guidance. Here is where I am at right now.

1. Real Symmetric: A = AT --> aij=aji

2. Positive Definite: xTAx > 0 for x not equal to 0, also aii and ajj > 0

So, I did this out for a 2x2 matrix A: xTAx

In the end I got: a11x12 + a22x22+2a12x1x2 > 0


Then, I get down to: (a11x12+a22x22)/2 > |a12x1x2|

However, we don't want the x's in here, and I still do not really understand how to apply this to a symmetric positive definite matrix in general (a more general case as opposed to this 2x2). Thank you again!
 
  • #5
Substitute x1=0 and x2=1, x1=1 and x2=0 and finally x1=1 and x2=1. Put these into the first inequality. Your derivation so far doesn't prove the second one because you don't know a11 and a22 are positive. Look at what the three resulting inequalities tell you. This is basically the contents of my first post.
 
  • #6
azdang said:
2. Positive Definite: xTAx > 0 for x not equal to 0, also aii and ajj > 0

Yes, for any [itex]\itex{x}\in\mathbb{R}^n[/itex] not equal to [itex]\vec{0}[/itex]. That means you can choose the components to be, say, one.

Then, I get down to: (a11x12+a22x22)/2 > |a12x1x2|

What do you get when you set all of the [itex]x_i[/itex] equal to one?

To generalize, try to answer the question in Dick's post. Can you express [itex]\left(\vec{e}_i+\vec{e_j}\right)^TA\left(\vec{e}_i+\vec{e}_j\right)[/itex] in terms of the [itex]a_{ij}[/itex]?
 
  • #7
Why don't you know a_11 and a_22 are positive? They are diagonal elements on a symmetric positive definite matrix, doesn't that imply that they are positive?
 
  • #8
azdang said:
Why don't you know a_11 and a_22 are positive? They are diagonal elements on a symmetric positive definite matrix, doesn't that imply that they are positive?

It does, but you haven't shown it yet. If you have already proved that, then never mind.
 
  • #9
Yes, it was a fact stated in class, so I won't have to show it. Thank you though :)

Unfortunately, I'm still completely confused how to show this generally.

I tried doing something with (ei+ej)TA(ei+ej)>0. All I got was aii+ajj>0, which we already know is true, so I'm guessing I didn't do that right.
 
  • #10
azdang said:
Yes, it was a fact stated in class, so I won't have to show it. Thank you though :)

Unfortunately, I'm still completely confused how to show this generally.

I tried doing something with (ei+ej)TA(ei+ej)>0. All I got was aii+ajj>0, which we already know is true, so I'm guessing I didn't do that right.

You didn't do it right. ei^T A ej and ej^T A ei give you contributions too. What are they?
 
  • #11
Oh duh, thank you. I'll try that. Thanks so much.
 
  • #12
azdang said:
Oh duh, thank you. I'll try that. Thanks so much.

Hint: you'll also need to think about (ei-ej)^T A (ei-ej)>0 to complete the inequality.
 
  • #13
Okay, let me try this again.



(ei+ej)TA(ei+ej)>0

eiTAei+ejTAei+eiTAej+ejTAej>0

aii+aji+aij+ajj>0

but aji=aij so

aii+ajj+2aij>0

aii+ajj>-2aij

aii+ajj>|-2aij| since the left side is positive anyways

(aii+ajj)/2>|aij|

I think this is okay now. Thank you SO much for all of your patience and help!
 
  • #14
Dick said:
Hint: you'll also need to think about (ei-ej)^T A (ei-ej)>0 to complete the inequality.

Thanks. Is it possible though to just take the absolute value of both sides knowing that the left side is already positive?
 
  • #15
Nope, doesn't quite work. a>b doesn't imply a>|b|. b could be negative and |b|>a. You need both a>b and a>-b. See my last hint.
 
  • #16
Thank you SO SO SO much, Dick. I really appreciate you walking me through this.
 

1. What is a real symmetric positive definite matrix?

A real symmetric positive definite matrix is a square matrix where all the diagonal entries are positive and all the off-diagonal entries are equal to their corresponding entries in the transposed matrix. This means that the matrix is symmetric and has all positive eigenvalues.

2. How is a real symmetric positive definite matrix different from a regular symmetric matrix?

A real symmetric positive definite matrix is a special type of symmetric matrix where all the diagonal entries are positive. In a regular symmetric matrix, the diagonal entries can be positive, negative, or zero.

3. What are the properties of a real symmetric positive definite matrix?

A real symmetric positive definite matrix has the following properties:

  • All eigenvalues are positive.
  • All principal minors are positive.
  • It is symmetric.
  • It is invertible.

4. How can a real symmetric positive definite matrix be used in data analysis?

Real symmetric positive definite matrices are commonly used in data analysis for various tasks such as principal component analysis, linear regression, and multivariate analysis. They are also used in machine learning algorithms such as gradient descent and support vector machines.

5. How can one determine if a matrix is real symmetric positive definite?

There are several ways to determine if a matrix is real symmetric positive definite:

  • Check if all eigenvalues are positive.
  • Check if all principal minors are positive.
  • Check if the matrix is symmetric.
  • Use the Cholesky decomposition method to see if the matrix can be written as the product of a lower triangular matrix and its transpose.

Similar threads

  • Calculus and Beyond Homework Help
Replies
2
Views
1K
  • Calculus and Beyond Homework Help
Replies
1
Views
1K
  • Calculus and Beyond Homework Help
Replies
2
Views
1K
  • Math POTW for Graduate Students
Replies
1
Views
545
  • General Engineering
Replies
1
Views
1K
  • Math POTW for Graduate Students
Replies
1
Views
409
  • Calculus and Beyond Homework Help
Replies
0
Views
39
  • Calculus and Beyond Homework Help
Replies
2
Views
2K
  • Linear and Abstract Algebra
Replies
12
Views
1K
Replies
9
Views
1K
Back
Top