Dismiss Notice
Join Physics Forums Today!
The friendliest, high quality science and math community on the planet! Everyone who loves science is here!

Homework Help: Method of Least Squares question

  1. Jun 14, 2010 #1
    1. The problem statement, all variables and given/known data

    for vector space C[-1,1] with L^2 inner product

    <f,g> = [tex]\int[/tex]f(x)g(x)dx

    find the best least squares approximation for function x^(1/3) on [-1,1] by a quadratic function q(x) = c0 + c1x + c2x^2

    2. Relevant equations

    s+r = n

    <t^s, t^r> = [tex]\int[/tex]t^ndt = { 2/(n+1) if n is even
    0 if n is odd }

    3. The attempt at a solution

    q(x) = c0*1 + c1*x + c2*x^2

    take inner product of functions of q(x)

    ||1|| = sqrt(2)
    ||x|| = sqrt(2/3)
    ||x^2|| = sqrt(2/5)

    normalize vectors in the basis

    [tex]\hat{u1}[/tex] = 1/sqrt(2)
    [tex]\hat{u2}[/tex] = x/sqrt(2/3)
    [tex]\hat{u3}[/tex] = x^2/sqrt(2/5)

    find coefficients by taking integrals of unit vectors with function x^1/3

    c1 = (1/sqrt(2))[tex]\int[/tex]x^1/3dx = [tex]\stackrel{3}{4sqrt(2)}[/tex]

    c2 = (1/sqrt(2/3))[tex]\int[/tex]x^4/3dx = [tex]\stackrel{3}{7sqrt(2/3)}[/tex]

    c3 = (1/sqrt(2/5))[tex]\int[/tex]x^7/3dx = [tex]\stackrel{3}{10sqrt(2/5)}[/tex]

    therefore p(x) = c1[tex]\hat{u1}[/tex] + c2[tex]\hat{u2}[/tex] + c3[tex]\hat{u3}[/tex]

    just wanting to confirm my answer, thanks for any and all help anyone can give and I'll write back this time, lol
  2. jcsd
  3. Jun 14, 2010 #2


    User Avatar
    Homework Helper

    are your basis functions orthogonal? i think that might help...
  4. Jun 14, 2010 #3
    I did test for that, 1 and x were orthogonal, x and x^2 were orthogonal, however 1 and x^2 were not orthogonal and neither were any of the functions with eachother, to try and remidy this I changed the functions such that I added a variable to make them orthogonal or make their integral equal to zero, so

    [tex]\int[/tex]1dx = [tex]\int[/tex]adx = 0

    [tex]\int[/tex]x^2dx = [tex]\int[/tex](x-a)^2dx = 0

    [tex]\int[/tex]x^2x^2dx = [tex]\int[/tex]x^4dx = [tex]\int[/tex](x-a)^4dx = 0

    however many of my solutions except the first one turned into some horrible monster with complex numbers and wasn't so sure that was correct, was my reasoning correct to do this?
  5. Jun 14, 2010 #4


    User Avatar
    Homework Helper

    or the least squares method to miinimise the error, i'm pretty sure your functions need to be orthonormal (actualy orthogonal, but as the normlaisation helps), the way to do it is thorugh gram schimdt type process

    so for the zeroth order function, pick the most general constant
    [tex]f_0(x) = a [/tex]
    test nomalisation
    [tex]\int_{-1}^{1} dx (f_0(x))^2 = 2a^2 [/tex]
    [tex]f_0(x) = \frac{1}{\sqrt{2}} [/tex]

    and again for the next, f1
    [tex]f_1(x) = b + cx [/tex]
    test orthognality
    [tex]\int_{-1}^{1} dx (f_0(x).f_1(x))
    = \int_{-1}^{1} dx \frac{1}{\sqrt{2}} (b+cx)
    = \frac{1}{\sqrt{2}}(bx+cx^2) _{-1}^{1}
    = \frac{1}{\sqrt{2}}(b(1-(-1)) +c(1^2-(-1)^2))
    = \frac{1}{\sqrt{2}}(2b) = 0

    hence b = 0 (as you found), then do the normalisation for c, and for the last, start from
    d + ex +fx^2
Share this great discussion with others via Reddit, Google+, Twitter, or Facebook