Playing with projection matrices: How did A^3 become the identity matrix?

Click For Summary
SUMMARY

The discussion focuses on understanding the properties of projection matrices, specifically how \( A^3 \) becomes the identity matrix \( I \). The user attempts to derive the relationship using matrix manipulation, noting that the standard matrix must be 2x2 to accommodate vectors \( u, v, w \). The key observation is that \( A^3u = u \) and \( A^3v = v \), indicating that applying the projection matrix three times results in the original vectors, confirming the idempotent nature of the projection matrix.

PREREQUISITES
  • Understanding of linear algebra concepts, particularly projection matrices.
  • Familiarity with matrix operations and properties, such as idempotence.
  • Knowledge of matrix inversion and its implications in linear transformations.
  • Experience with manipulating equations involving matrices and vectors.
NEXT STEPS
  • Study the properties of projection matrices in detail, focusing on idempotence and eigenvalues.
  • Learn about the derivation of the Moore-Penrose pseudoinverse and its applications.
  • Explore the implications of \( A(ATA)^{-1}AT \) in linear regression and least squares problems.
  • Investigate the geometric interpretation of projections in vector spaces.
USEFUL FOR

Students and professionals in mathematics, particularly those studying linear algebra, as well as anyone involved in data science or machine learning who needs to understand projection matrices and their properties.

Lifprasir
Messages
16
Reaction score
0
*new question, playing with projection matrix.

Homework Statement


This is the first problem of our practice exam.
http://puu.sh/1jReL

And here's the solution.
http://puu.sh/1jRg3


Homework Equations



The standard matrix has to be 2x2 to be compatible u v w, so this must be the reason why he limited the matrix to A (u v) = (v w) instead of A (u v w) = (v w u).

And then he used matrix properties to solve for A, and got it.

However what I don't understand is the part where it says "Observe that A^3u = u, A^3 u = v.


The Attempt at a Solution



I've tried doing,

(u v) = D
(v w) = X

so, AD = X
A = XD^-1

Then I tried to reverse the observation by doing,

A^3u = u
A^3 = I
(XD^-1)(XD^-1)(XD^-1)=I, but that's as far as I'm able to go.

I really don't understand how he was able to see how A^3 was I..

Well I have a new question about the A(ATA)-1AT matrix.

http://puu.sh/1jXT6

I was able to show that BT was idempotent, but my manipulation was a bit different from the teacher for B2

Let B2 = (A(ATA)-1AT)(A(ATA)-1AT)

I did (AA-1(AT)-1AT)A(ATA)-1AT = IA(ATA)-1AT=A(ATA)-1AT=B

The teacher did it in another method and I don't think my method is correct because it doesn't make sense that B = I.
 
Last edited by a moderator:
Physics news on Phys.org
Hi Lifprasir! :smile:

(try using the X2 button just above the Reply box :wink:)
Lifprasir said:
However what I don't understand is the part where it says "Observe that A^3u = u, A^3 u = v.

Because S3(u) = u, S3(v) = v :wink:
 
Ooooooooooooooooooooh. Thank you so much!
 

Similar threads

  • · Replies 5 ·
Replies
5
Views
2K
  • · Replies 5 ·
Replies
5
Views
3K
  • · Replies 2 ·
Replies
2
Views
2K
Replies
3
Views
2K
Replies
5
Views
2K
Replies
1
Views
2K
  • · Replies 7 ·
Replies
7
Views
22K
  • · Replies 7 ·
Replies
7
Views
3K
  • · Replies 1 ·
Replies
1
Views
3K
  • · Replies 2 ·
Replies
2
Views
2K