Orthonormal Sets - Find a projection matrix - Linear Algebra

Click For Summary
SUMMARY

The discussion centers on finding the projection matrix P that projects vectors in R4 onto the column space R(A) of the 4x2 matrix A defined as |1/2 -1/2|, |1/2 -1/2|, |1/2 1/2|, |1/2 1/2|. The orthonormal basis for R(A) is established using the vectors v1 = (1/2, 1/2, 1/2, 1/2)T and v2 = (-1/2, -1/2, 1/2, 1/2)T, which are confirmed to be orthogonal and normalized. The projection matrix is derived as P = A(A^TA)^{-1}A^T, leading to the final result of P = [0.5 -0.5 0 0; -0.5 0.5 0 0; 0 0 0.5 -0.5; 0 0 -0.5 0.5].

PREREQUISITES
  • Understanding of projection matrices in linear algebra
  • Familiarity with orthonormal sets and bases
  • Knowledge of matrix multiplication and transposition
  • Proficiency in using the Gram-Schmidt process for orthogonalization
NEXT STEPS
  • Study the derivation of projection matrices using the formula P = A(A^TA)^{-1}A^T
  • Learn about the Gram-Schmidt orthogonalization process for creating orthonormal bases
  • Explore the properties of orthogonal projections in higher-dimensional spaces
  • Investigate applications of projection matrices in data science and machine learning
USEFUL FOR

Students and professionals in mathematics, particularly those studying linear algebra, as well as data scientists and engineers working with projections in high-dimensional spaces.

aargoo
Messages
3
Reaction score
0

Homework Statement


Let A be the 4x2 matrix
|1/2 -1/2|
|1/2 -1/2|
|1/2 1/2|
|1/2 1/2|

Find the projection matrix P that projects vectors in R4 onto R(A)

Homework Equations


projSx = (x * u)u where S is a vector subspace and x is a vector

The Attempt at a Solution


v1 = (1/2, 1/2, 1/2, 1/2)T
v2 = (-1/2, -1/2, 1/2, 1/2)T
v1v2 = 0, hence the vectors are orthogonal
||v1|| = 1
||v2|| = 1, hence they form an orthonormal basis for R2

R(A) = span{(1/2, -1/2)T, (1/2, -1/2)T, (1/2, 1/2)T, (1/2, 1/2)T} = span{(1/2, -1/2)T, (1/2, 1/2)T}

And from here I am a bit lost. Would I define x as the standard basis for R4 and find projR(A)x ?

The answer from the book is given as
[.5 -.5 0 0]
[-.5 .5 0 0]
[0 0 .5 -.5]
[0 0 -.5 .5]

Thanks

Note: This is from a section before the Gram-Schmidt orthogonalization process
 
Last edited:
Physics news on Phys.org
The first thing I would do is determine R(A). Given any vector v= [x, y], we have
Av= \begin{bmatrix}\frac{1}{2} & -\frac{1}{2} \\ \frac{1}{2} & -\frac{1}{2} \\ \frac{1}{2} & \frac{1}{2} \\ \frac{1}{2} & \frac{1}{2}\end{bmatrix}\begin{bmatrix}x \\ y \end{bmatrix}= \begin{bmatrix}\frac{1}{2}x- \frac{1}{2}y \\ \frac{1}{2}x- \frac{1}{2}y \\ \frac{1}{2}x+ \frac{1}{2}y \\ \frac{1}{2}x+ \frac{1}{2}y\end{bmatrix}.

We can write that result as
\begin{bmatrix}a \\ a \\ b \\ b\end{bmatrix}= \begin{bmatrix}a \\ a \\ 0 \\ 0 \end{bmatrix}+ \begin{bmatrix}0 \\ 0 \\ b \\ b \end{bmatrix}= a\begin{bmatrix}1 \\ 1 \\ 0 \\ 0 \end{bmatrix}+ b\begin{bmatrix}0 \\ 0 \\ 1 \\ 1 \end{bmatrix}
where a= x/2+ y/2 and b= x/2- y/2. That is, a basis for R(A) is \{\begin{bmatrix}1 \\ 1 \\ 0 \\ 0 \end{bmatrix}, \begin{bmatrix} 0 \\ 0 \\ 1 \\ 1\end{bmatrix}\}.
 
Hmm, I'm still trying to figure out if I'm missing a formula somewhere...
A =
[1 0
1 0
0 1
0 1]

So, projAx = AATx
=
[1 1 0 0
1 1 0 0
0 0 1 1
0 0 1 1] x

I'm now confused as to how to find x? It should be a 4x4, correct?
 

Similar threads

  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 2 ·
Replies
2
Views
1K
Replies
4
Views
2K
  • · Replies 4 ·
Replies
4
Views
2K
  • · Replies 8 ·
Replies
8
Views
2K
  • · Replies 4 ·
Replies
4
Views
3K
  • · Replies 3 ·
Replies
3
Views
3K
  • · Replies 8 ·
Replies
8
Views
3K
  • · Replies 10 ·
Replies
10
Views
2K