Error on using a curve of best fit for extrapolation

Click For Summary

Discussion Overview

The discussion revolves around the calculation of uncertainty when using a curve of best fit, specifically an exponential curve, for extrapolation of data points gathered from an experiment. Participants explore methods for estimating uncertainty associated with their extrapolated values.

Discussion Character

  • Exploratory
  • Technical explanation
  • Mathematical reasoning

Main Points Raised

  • One participant describes their approach of using the equation of the curve to approximate values and expresses uncertainty about how to calculate the associated error.
  • Another participant suggests a formula for extrapolation error based on the standard deviation of the curve's parameters and the points of extrapolation.
  • A different participant proposes taking the natural logarithm of the best fit equation to derive uncertainties using least-squares fitting and error propagation, questioning how to incorporate measurement uncertainties.
  • This participant further discusses the implications of using a least-squares fit versus maximum likelihood estimation, highlighting potential biases in the estimates.
  • A later reply acknowledges the complexity of the approach and expresses gratitude for the clarification, indicating a shift in understanding.

Areas of Agreement / Disagreement

Participants do not reach a consensus on the best method for calculating uncertainty, and multiple approaches are discussed without resolution.

Contextual Notes

Participants mention various assumptions regarding the distribution of errors and the impact of measurement uncertainties on the fitting process, but these assumptions remain unresolved.

Woland
Messages
18
Reaction score
0
Hello everyone,

I did a quick search but could not find this in the forums.

I have quite a basic situation. I have been gathering data points from an experiment and was able to fit an exponential curve of best fit to it. What I want to do is approximate some values between my data points using this curve. My approach is to just use the equation of the curve and plug in the desired number. I will then add the uncertainty to it.

This uncertainty is what I am drawing a blank with. Does anyone know what method I could use to calculate this uncertainty. I have a feeling this is really simple, but... I can't remember anything yet.

Any help would be appreciated.
 
Physics news on Phys.org
Woland said:
Hello everyone,

I did a quick search but could not find this in the forums.

I have quite a basic situation. I have been gathering data points from an experiment and was able to fit an exponential curve of best fit to it. What I want to do is approximate some values between my data points using this curve. My approach is to just use the equation of the curve and plug in the desired number. I will then add the uncertainty to it.

This uncertainty is what I am drawing a blank with. Does anyone know what method I could use to calculate this uncertainty. I have a feeling this is really simple, but... I can't remember anything yet.

Any help would be appreciated.


If your curve is:

y=exp(c*x)

Your extrapolation error will be roughly:

Y=exp(sigma_c (x2-x1))+sigma_yo

Where:
sigma_c is the standard deviation in your estimate of c.
x1 is the point you are extrapolating from
x2 is the point you are extrapolating to.
sigma_yo is your initial error.
 
which method are you using to get the error equation?

I was thinking of something along the lines of:
If I have y = A exp(Bx) as my best fit, I can take the ln of both sides:

ln y = B lnA + B ln x

I can now do a line of best fit and find sigma lny, sigma A and sigma B.
These are the uncertainties in the fit which I get from the least - squares method. I can now use the error propagation formula to get the uncertainty in y.

My question is, where do I incorporate the uncertainty in my measurments.
 
Woland said:
which method are you using to get the error equation?

I was thinking of something along the lines of:
If I have y = A exp(Bx) as my best fit, I can take the ln of both sides:

ln y = B lnA + B ln x

I can now do a line of best fit and find sigma lny, sigma A and sigma B.
These are the uncertainties in the fit which I get from the least - squares method. I can now use the error propagation formula to get the uncertainty in y.

My question is, where do I incorporate the uncertainty in my measurments.

Well, let's say y=<y(x)>+rv
Where:
<y(x)> is the mean value of y at x and rv is a random variable.

Lets assume for a sec that rv is a quasian distribution then:

P(y)=integral{-00,-00}1/(sigma*2pi)*exp(-(y-y_bar)^2/(2*sigma^2))dy

To get ln y do a change of variables on the above expression for P(y)

u=ln(y) <=> y=exp(u)

The term inside the integrand will be your new distribution function for ln y

See functions of random variables:
http://cnx.org/content/m11066/latest/

Keep in mind that
<ln y>
does not equal
ln <y>

Thus a least mean squared fit of ln y will be biased. Measurements where y is much smaller then the standard deviation of the random variable will be more biased. You can do the transformation before the fit but if your error is large compared to your measurement then you’ll need to use maximum likelihood. If you use least squares then weight large values of y exponentially more then small values of y.

Also note that:

if <y>=Aexp(BX)
Then:
<ln y> does not equal: BX + ln(A)

Rather it is equal to <ln (<y(x)> +rv)>

Which we can’t really separate neatly into the form you gave.
 
Ah thank you for clarifying. I knew something was too easy about my approach. I don't have time to try this now, but I am sure it will work. Thank you.
 

Similar threads

  • · Replies 4 ·
Replies
4
Views
2K
  • · Replies 28 ·
Replies
28
Views
3K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 16 ·
Replies
16
Views
3K
  • · Replies 16 ·
Replies
16
Views
3K
Replies
28
Views
4K
  • · Replies 8 ·
Replies
8
Views
2K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 30 ·
2
Replies
30
Views
4K
Replies
8
Views
2K