1. Limited time only! Sign up for a free 30min personal tutor trial with Chegg Tutors
    Dismiss Notice
Dismiss Notice
Join Physics Forums Today!
The friendliest, high quality science and math community on the planet! Everyone who loves science is here!

Homework Help: Help, null space projection!

  1. Jan 7, 2010 #1
    Hello everyone,

    If I have a collection of data points (vectors), and x and y are two vectors among them. I want to project the data to a direction that the Euclidean distance between x and y is Maximally preserved. Then this direction should be the row space of (x-y)’, denoted as row( (x-y)’ ), right? (suppose column vectors.)

    Now, suppose I have n pairs of such data points grouped as a matrix A, say

    A = [
    (x1 – y1)’
    (x2 – y2)’

    (xn –yn)’
    ]

    For my problem, directly calculate the row space projection matrix P1 = A’*inv(AA’)*A is difficult, so I want to do some approximation.

    Suppose all the vectors have been normalized, that is norm(x1) = norm(x2) = … = norm(xn) = norm(y1) = .. = norm(yn). I define matrix B as

    B = [
    (x1 + y1)’
    (x2 + y2)’

    (xn + yn)’
    ]

    And plan to find the null space of B, denoted as null(B). It is easy for me to calculate the null space projection matrix P2 = I – B’*inv(BB’)*B. Note that, (xi – yi)’*(xi+yi) = 0 for normalized vectors.

    I feel that null(B) = row(A) . Is it true? Or what’s the relationship between null(B) and row(A)? Can I make the conclusion that, if I project data to null(B), those pair of points (xi, yi) will also be maximally separated?

    I’m waiting online. Any input will be appreciated! You’re welcome to send me emails!

    Thank you very much!

    Sue
     
  2. jcsd
  3. Jan 7, 2010 #2
    about null space projection

    1. The problem statement, all variables and given/known data
    If I have a collection of data points (vectors), and x and y are two vectors among them. I want to project the data to a direction that the Euclidean distance between x and y is Maximally preserved. Then this direction should be the row space of (x-y)’, denoted as row( (x-y)’ ), right? (suppose column vectors.)
    Now, suppose I have n pairs of such data points grouped as a matrix A, say

    A = [
    (x1 – y1)’
    (x2 – y2)’

    (xn –yn)’
    ]

    For my problem, directly calculate the row space projection matrix P1 = A’*inv(AA’)*A is difficult, so I want to do some approximation.



    2. Relevant equations



    3. The attempt at a solution

    Suppose all the vectors have been normalized, that is norm(x1) = norm(x2) = … = norm(xn) = norm(y1) = .. = norm(yn). I define matrix B as

    B = [
    (x1 + y1)’
    (x2 + y2)’

    (xn + yn)’
    ]

    And plan to find the null space of B, denoted as null(B). It is easy for me to calculate the null space projection matrix P2 = I – B’*inv(BB’)*B. Note that, (xi – yi)’*(xi+yi) = 0 for normalized vectors.

    I feel that null(B) = row(A) . Is it true? Or what’s the relationship between null(B) and row(A)? Can I make the conclusion that, if I project data to null(B), those pair of points (xi, yi) will also be maximally separated?


    I’m waiting online. Any input will be appreciated! You’re welcome to send me emails!

    Thank you very much!

    Sue
     
  4. Jan 7, 2010 #3
    Please, give me some feedback
     
Share this great discussion with others via Reddit, Google+, Twitter, or Facebook