Interpolation Method: Solving Missing Data

  • Context: Undergrad 
  • Thread starter Thread starter danutz
  • Start date Start date
  • Tags Tags
    Interpolation Method
Click For Summary
SUMMARY

The discussion focuses on methods for interpolating missing temperature data from a text file containing timestamps and temperature readings. The user seeks a solution that incorporates not only adjacent values but also corresponding temperatures from the previous and next days. While polynomial interpolation has been attempted, the user is advised to consider trigonometric interpolation for periodic data, specifically using sine functions adjusted for a 24-hour period. However, the user emphasizes the need for a more complex approach that combines multiple functions for accurate interpolation.

PREREQUISITES
  • Understanding of interpolation methods, specifically polynomial and trigonometric interpolation.
  • Familiarity with time series data and its periodic nature.
  • Basic knowledge of mathematical functions and their applications in data analysis.
  • Experience with data manipulation in programming languages such as Python or R.
NEXT STEPS
  • Research advanced interpolation techniques, such as Kriging or spline interpolation.
  • Explore time series analysis methods, particularly seasonal decomposition and forecasting.
  • Learn about the implementation of trigonometric interpolation in Python using libraries like NumPy or SciPy.
  • Investigate how to combine multiple interpolation functions for enhanced accuracy in data estimation.
USEFUL FOR

Data scientists, statisticians, and anyone involved in time series analysis or missing data imputation will benefit from this discussion.

danutz
Messages
2
Reaction score
0
hi i need some help with a problem I'm dealing with
i have a text file of this format
01 08 2002 12 45 26.7
01 08 2002 13 00 27.8
01 08 2002 13 15 27.0
01 08 2002 13 30 28.2
the last being the temperature and i need to interpolate some missing elements using not only the values before and after that elem but also the previous and next day temperatures (meaning if i wanted to interpolate the second row i would need to use the 1st the third and the values at 13:00 in the previous and next day for example) i would really appreciate if someone could tell me which method to use
ps:i used a polynomial interpolation so far
 
Physics news on Phys.org
Hi danutz! :smile:

Because the solution must be periodic, I guess that trigonometric interpolation could give you something good: http://en.wikipedia.org/wiki/Trigonometric_interpolation

But note, if you use the sine functions, then you will be periodic with period [itex]2\pi[/itex]. If you want to be periodic with period T (for example, 24h), then you will have to use

[tex]f(x)=\sin(\frac{2\pi}{T}x)[/tex]

instead of the sine.
 
thanks i looked through it but my function won't be a periodic function but one that has somehow random values so it cannot be defined like f(x)=...
i need a method that doesn't interpolate only by the interp polynomial but also by some other values(the temperatures in other days at the same hour) i think it's more like having more than one function and for interpolating f(x0) i need g(x0) and h(x0) and f(points i use to make the polynomial interpolation, x1 x2 ...)

or is it ok to make the polyn interpolation, obtain an f(x0) and just to make some calculus like 3/4f(x0)+ (h(x0)+g(x0))/2/4??
 
Last edited:

Similar threads

  • · Replies 1 ·
Replies
1
Views
1K
  • · Replies 1 ·
Replies
1
Views
1K
  • · Replies 8 ·
Replies
8
Views
5K
Replies
8
Views
2K
  • · Replies 65 ·
3
Replies
65
Views
9K
  • · Replies 26 ·
Replies
26
Views
3K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 5 ·
Replies
5
Views
2K
  • · Replies 10 ·
Replies
10
Views
26K
Replies
1
Views
3K