Can the null space of matrix B be used for data projection?

Click For Summary
SUMMARY

The discussion centers on the relationship between the null space of matrix B and the row space of matrix A in the context of data projection for maximizing the Euclidean distance between pairs of vectors. The user, Sue, defines matrix B as the sum of paired vectors and seeks to establish whether the null space of B, denoted as null(B), is equivalent to the row space of matrix A, denoted as row(A). The projection matrices P1 and P2 are defined, with P1 being difficult to compute directly, while P2 is derived from B. The conclusion sought is whether projecting data onto null(B) will also maximize the separation of the vector pairs.

PREREQUISITES
  • Understanding of linear algebra concepts, specifically null spaces and row spaces.
  • Familiarity with matrix operations, including matrix inversion and transposition.
  • Knowledge of Euclidean distance and its application in vector analysis.
  • Experience with projection matrices in the context of data analysis.
NEXT STEPS
  • Explore the properties of null spaces and row spaces in linear algebra.
  • Learn about the Singular Value Decomposition (SVD) and its applications in data projection.
  • Investigate the implications of vector normalization on projections and distances.
  • Study the derivation and application of projection matrices in machine learning contexts.
USEFUL FOR

Data scientists, mathematicians, and machine learning practitioners interested in advanced data projection techniques and the mathematical foundations of vector relationships.

Sue_2010
Messages
8
Reaction score
0
Hello everyone,

If I have a collection of data points (vectors), and x and y are two vectors among them. I want to project the data to a direction that the Euclidean distance between x and y is Maximally preserved. Then this direction should be the row space of (x-y)’, denoted as row( (x-y)’ ), right? (suppose column vectors.)

Now, suppose I have n pairs of such data points grouped as a matrix A, say

A = [
(x1 – y1)’
(x2 – y2)’

(xn –yn)’
]

For my problem, directly calculate the row space projection matrix P1 = A’*inv(AA’)*A is difficult, so I want to do some approximation.

Suppose all the vectors have been normalized, that is norm(x1) = norm(x2) = … = norm(xn) = norm(y1) = .. = norm(yn). I define matrix B as

B = [
(x1 + y1)’
(x2 + y2)’

(xn + yn)’
]

And plan to find the null space of B, denoted as null(B). It is easy for me to calculate the null space projection matrix P2 = I – B’*inv(BB’)*B. Note that, (xi – yi)’*(xi+yi) = 0 for normalized vectors.

I feel that null(B) = row(A) . Is it true? Or what’s the relationship between null(B) and row(A)? Can I make the conclusion that, if I project data to null(B), those pair of points (xi, yi) will also be maximally separated?

I’m waiting online. Any input will be appreciated! You’re welcome to send me emails!

Thank you very much!

Sue
 
Physics news on Phys.org
about null space projection

Homework Statement


If I have a collection of data points (vectors), and x and y are two vectors among them. I want to project the data to a direction that the Euclidean distance between x and y is Maximally preserved. Then this direction should be the row space of (x-y)’, denoted as row( (x-y)’ ), right? (suppose column vectors.)
Now, suppose I have n pairs of such data points grouped as a matrix A, say

A = [
(x1 – y1)’
(x2 – y2)’

(xn –yn)’
]

For my problem, directly calculate the row space projection matrix P1 = A’*inv(AA’)*A is difficult, so I want to do some approximation.



Homework Equations





The Attempt at a Solution



Suppose all the vectors have been normalized, that is norm(x1) = norm(x2) = … = norm(xn) = norm(y1) = .. = norm(yn). I define matrix B as

B = [
(x1 + y1)’
(x2 + y2)’

(xn + yn)’
]

And plan to find the null space of B, denoted as null(B). It is easy for me to calculate the null space projection matrix P2 = I – B’*inv(BB’)*B. Note that, (xi – yi)’*(xi+yi) = 0 for normalized vectors.

I feel that null(B) = row(A) . Is it true? Or what’s the relationship between null(B) and row(A)? Can I make the conclusion that, if I project data to null(B), those pair of points (xi, yi) will also be maximally separated?


I’m waiting online. Any input will be appreciated! You’re welcome to send me emails!

Thank you very much!

Sue
 
Please, give me some feedback
 

Similar threads

  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 10 ·
Replies
10
Views
5K
Replies
15
Views
3K
  • · Replies 4 ·
Replies
4
Views
2K
  • · Replies 9 ·
Replies
9
Views
4K
  • · Replies 2 ·
Replies
2
Views
3K
Replies
8
Views
2K
  • · Replies 14 ·
Replies
14
Views
4K
  • · Replies 16 ·
Replies
16
Views
4K
Replies
10
Views
2K