Fitting data to complicated model

  • Thread starter yumyumyum
  • Start date
  • #1
yumyumyum
4
0
1) For standard non-linear least squares, the standard approaches are to either
a) to use the jacobian to linearize, and proceed with linear regression, or to
b) linearize the raw data

2) When data needs to be "fit" to a complicated model (e.g. some non-linear differential equation) that has no closed form analytic solution, people typically run a simulation varying the model parameters until the least squares residuals is minimized. Fit parameter distributions are then estimated using monte carlo boostrap, or a polynomial approximation in the vicinity of the residual least squares minimum.

Has anyone here seen any literature about linearizing the data for case 2 and fitting with a difference equation approximation for the non-linear dif. e.q. ? For example let's say our data is described by y = A*exp(-t/tau)+c. The y data can be linearized by with a time difference approximation

y(t+1)-y(t)/dt = -y(t)/tau.

and the equation above can be use to fit it. This technique would also apply to more complicated non-linear diffy q's so long they can represented as difference equations.
 

Answers and Replies

  • #2
JJacquelin
801
34
A straightforward method to fit the function y = A*exp(-t/tau)+c is presented papes 16-17 in the paper :

https://fr.scribd.com/doc/14674814/Regressions-et-equations-intégrales

In this paper it is shown that fitting functions from differential equation is not robust in case of scattered data. It is suggested to use integral equation instead of differential (so, to first transform it into integral equation).
 
  • Like
Likes yumyumyum
  • #3
yumyumyum
4
0
Thanks for the reply jjac. Unfortunately i don't speak french :[

A better way of phrasing my question is. Can one transform the raw data into a phase space representation, and then fit the transformed data using equations describing phase space for the diffy q. This would be useful since extracting phase space equations from a non-linear differential equation is easier then solving the deffy q.
 
  • #4
JJacquelin
801
34
@ yumyumyum : Sorry, I have no answer on this way.
 
  • #5
Svein
Science Advisor
Insights Author
2,251
773
For example let's say our data is described by y = A*exp(-t/tau)+c. The y data can be linearized by with a time difference approximation

y(t+1)-y(t)/dt = -y(t)/tau.
As long as you have an idea of the mathematical relationship, you can use several techniques to determine the parameters. The problem is that your "idea of a mathematical relationship" will "pollute" the data. Usually, a set of wildly different mathematical relationships can be used to describe a data set with whatever degree of accuracy you want.

For a more stringent explanation, check out Bayesian statistics (https://en.wikipedia.org/wiki/Bayesian_statistics).
 
  • #6
HallsofIvy
Science Advisor
Homework Helper
43,021
970
I've never heard of "fitting data to a model". I thought the objective was always the other way around- to fit the model to the data.
 

Suggested for: Fitting data to complicated model

  • Last Post
Replies
6
Views
431
  • Last Post
Replies
0
Views
281
  • Last Post
Replies
22
Views
2K
Replies
76
Views
2K
Replies
19
Views
1K
Replies
7
Views
231
  • Last Post
Replies
2
Views
232
Replies
4
Views
579
  • Last Post
Replies
1
Views
623
Replies
49
Views
2K
Top