Orthogonal Eigenvector, Proof is bothering me

Click For Summary
SUMMARY

The discussion centers on the proof of orthogonal eigenvectors in the context of symmetric matrices, specifically when \( A = A^T \). The participants clarify the process of taking dot products of eigenvalue equations \( A\overrightarrow{x} = \lambda_1\overrightarrow{x} \) and \( A\overrightarrow{y} = \lambda_2\overrightarrow{y} \). They emphasize that the dot product can be expressed as matrix multiplication, leading to the conclusion that \( \overrightarrow{x}^TA\overrightarrow{y} = \overrightarrow{x}\cdot A\overrightarrow{y} \), reinforcing that \( \overrightarrow{y}^T \) does not equal \( \overrightarrow{y} \).

PREREQUISITES
  • Understanding of eigenvalues and eigenvectors
  • Familiarity with symmetric matrices
  • Knowledge of matrix multiplication and transposition
  • Basic concepts of linear algebra
NEXT STEPS
  • Study the properties of symmetric matrices and their eigenvalues
  • Learn about the Gram-Schmidt process for orthogonalization
  • Explore the implications of the Spectral Theorem in linear algebra
  • Investigate applications of eigenvectors in Principal Component Analysis (PCA)
USEFUL FOR

Mathematicians, students of linear algebra, and professionals working with eigenvalues and eigenvectors in various applications, including data science and machine learning.

rocomath
Messages
1,752
Reaction score
1
Suppose

[tex]A\overrightarrow{x}=\lambda_1\overrightarrow{x}[/tex]
[tex]A\overrightarrow{y}=\lambda_2\overrightarrow{y}[/tex]
[tex]A=A^T[/tex]

Take dot products of the first equation with [tex]\overrightarrow{y}[/tex] and second with [tex]\overrightarrow{x}[/tex]

ME 1) [tex](A\overrightarrow{x})\cdot \overrightarrow{y}=(\lambda_1\overrightarrow{x})\cdot\overrightarrow{y}[/tex]

BOOK ... skipped steps but only shows this 1) [tex](\lambda_1\overrightarrow{x})^T\overrightarrow{y}=(A\overrightarrow{x})^T\overrightarrow{y}=\overrightarrow{x}^TA^T\overrightarrow{y}=\overrightarrow{x}^TA\overrightarrow{y}=\overrightarrow{x}^T\lambda_2\overrightarrow{y}[/tex]

Now it looks like I have to transpose my first step, but if I do so, do I assume that [tex]y=y^T[/tex]?
 
Last edited:
Physics news on Phys.org
Note that the dot product of two vectors is just a matrix multiplication. E.g. if we take [itex]\vec x, \vec y[/itex] to be (n x 1) column vectors then the dot product is just
[tex]\vec x \cdot \vec y = \vec x^T \vec y[/tex]
where the right hand side is just matrix multiplication of an (1 x n) with an (n x 1) matrix. Then the solution easily follows. Try to write it out and indicate what is being done in each step.
 
rocomath said:
Suppose

[tex]A\overrightarrow{x}=\lambda_1\overrightarrow{x}[/tex]
[tex]A\overrightarrow{y}=\lambda_2\overrightarrow{y}[/tex]
[tex]A=A^T[/tex]

Take dot products of the first equation with [tex]\overrightarrow{y}[/tex] and second with [tex]\overrightarrow{x}[/tex]

ME 1) [tex](A\overrightarrow{x})\cdot \overrightarrow{y}=(\lambda_1\overrightarrow{x})\cdot\overrightarrow{y}[/tex]

BOOK ... skipped steps but only shows this 1) [tex](\lambda_1\overrightarrow{x})^T\overrightarrow{y}=(A\overrightarrow{x})^T\overrightarrow{y}=\overrightarrow{x}^TA^T\overrightarrow{y}=\overrightarrow{x}^TA\overrightarrow{y}=\overrightarrow{x}^T\lambda_2\overrightarrow{y}[/tex]

Now it looks like I have to transpose my first step, but if I do so, do I assume that [tex]y=y^T[/tex]?
You don't, they are not the same.

What you are doing is thinking of the dot product [itex]\vec{u}\cdot\vec{v}[/itex] as the matrix product [itex]\vec{u}^T\vec{v}[/itex] where [itex]\vec{u}[/itex] and [itex]\vec{v}[/itex] are "column" matrices and [itex]\vec{u}^T[/itex] is the "row" matrix corresponding to [itex]\vec{v}[/itex]. It Then follows that [itex](A\vec{x}\cdot\vec{y}= (A\vec{x})^T\vec{y}= \vec{x}^TA^T\vec{y}[/itex] which, because AT= A is the same as [itex]\vec{x}^TA\vec{y}= \vec{x}\cdot A\vec{y}[/itex]. It is not that [itex]\vec{y}^T= \vec{y}[/itex], you never have "[itex]\vec{y}^T[/itex].
 

Similar threads

Replies
1
Views
2K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 7 ·
Replies
7
Views
4K
  • · Replies 14 ·
Replies
14
Views
2K
  • · Replies 6 ·
Replies
6
Views
3K
  • · Replies 7 ·
Replies
7
Views
4K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 3 ·
Replies
3
Views
3K
Replies
2
Views
2K
Replies
4
Views
2K