Forcing a Least squares Polynomial through a fixed point

  1. Hi guys,

    Thanks for taking the time to read the post.

    I have a question related to curve fitting and polynomials that i was hoping someone might be able to help me with.

    I have a set of x and y data points, all on a graph. I have then calculated the 4th order least squares polynomial for those points, which gives me an equation for that fit.

    I would now like to go one step further and calculate what the least squares polynomial will be if i force the fit line through the last data point? Does anyone have a reference or any advice on how to do this?

    Many thanks for your help in advance,

  2. jcsd
  3. Redbelly98

    Redbelly98 12,046
    Staff Emeritus
    Science Advisor
    Homework Helper

    Welcome to Physics Forums.

    I would shift the data so that last data point is at the origin. Then fit a polynomial with the constant term =0, to force it to contain that point at the origin. Finally, do a reverse shift on that polynomial to match it up with the original data.

    Hope that helps.
  4. Thank you so much Redbelly, that is an outstanding answer! I think i may have been trying to overcomplicate the solution to this.

    So as i understand it;

    1- calculate the original polynomial which will yeild an equation of: ax^4 + bx^3 + cx^2 + dx + e,
    2- reverse the data so that the last data point is now first.
    3- set (in my case) e = 0;
    4- recalculate the polynomial using the first data point as (0,0).

    this should give me a new polynomial fit that passes right through the origin?

    the only bit I am unclear about is the reverse shift, what do you mean by do a reverse shift?

    many thanks for your help,

  5. Hello !
    If the fixed point is (a,b) with a and b given constants, simply write the polynomial as :
    y(x) = b + (x-a)*P(x) where P(x) is a polynomial which coefficients can be computed thanks to least squares fitting.
    Alternatively, you may define Y(x) = (y-b)/(x-a) so that each value of Y can be previously computed from each given couple (x,y). Then the coefficients of the polynomial P can be computed thanks to least squares fitting. (But not convenient if (x-a)=0, or too close to 0, for a particular point)
    Both methods will lead to slightly différent polynomial b+(x-a)*P(x) because the criterium for least squares are not the same. But, generally, the difference of fitting will be quite small.
    Last edited: Aug 23, 2011
  6. hotvette

    hotvette 931
    Homework Helper

    In general you are talking about least squares with equality constraints, which can be solved using Lagrange Multipliers. But, with only one constraint, there is an easier approach. Let n denote the last point (i.e. the one you want to fit exactly). Then you have:

    yn = axn4 + bxn3 + cxn2 + dxn + e


    e = yn - axn4 - bxn3 - cxn2 - dxn

    If you substitute this expression for e into your original equation you end up with a function of only 4 parameters (a,b,c,d) which can be used for your least squares fit.
  7. Hurkyl

    Hurkyl 15,987
    Staff Emeritus
    Science Advisor
    Gold Member

    If you're lazy and close is good enough, you could just put a near-infinite weight on the error at the point you want your curve to pass through.
  8. Thank you so much for the help guys, its really helped me out loads!

    Its a huge tribute to the forum that i could get such accutrate and comprehensive guidance. Many thanks to all!!
  9. Redbelly98

    Redbelly98 12,046
    Staff Emeritus
    Science Advisor
    Homework Helper

    Glad you got other good suggestions.
    Not quite, I'll explain with more details below.
    More detailed explanation:

    1. You have some (x,y) data values:
    (x1, y1)
    (x2, y2)
    (xN, yN)​

    2. Make a new set of data -- let's call these (x', y') -- by subtracting (xN, yN) from each (x,y) value. (This is the shift):
    (x1-xN, y1-yN) = (x1', y1')
    (x2-xN, y2-yN) = (x2', y2')
    (xN-xN, yN-yN) = (0,0) = (xN', yN')​

    3. Fit a polynomial, without the constant term, to the new data (x', y'). Since there is no constant term, the fit will contain the point (xN',yN')=(0,0), as required.

    Eg., for a cubic you would have
    y' = ax'3 + bx'2 + cx'​

    4. We want to get an equation for x & y from the equation we have for x' and y'. This is the reverse shift.
    Using the substitutions
    x = x' + xN
    y = y' + yN​
    We get
    y + yN = a(x+xN)3 + b(x+xN)2 + c(x+xN)​
    y = a(x+xN)3 + b(x+xN)2 + c(x+xN) - yN ​
    You could either expand out the (x+xN)n terms, or leave them in that form.
  10. If your polynomial is of power N, having one fixed point makes a definite relation among the N + 1 coefficients and they are no longer independent. You may want to use the Lagrange multiplier method when differentiating the sum of the squared errors to find its minimum (least squares method).
Know someone interested in this topic? Share this thead via email, Google+, Twitter, or Facebook

Have something to add?