Optimal discretization and expansion order of arbitrary data

Click For Summary
SUMMARY

The discussion focuses on the optimal discretization and expansion order of a large dataset consisting of approximately 20,000 f(x) vs x points. The goal is to minimize the number of subdomains and the expansion orders, likely using Legendre polynomials, for functional expansion within each subdomain. Participants suggest researching "function approximation" and "approximation by rational functions" as foundational topics, along with techniques like automatic knot placement for spline curve fitting to achieve efficient data representation.

PREREQUISITES
  • Understanding of function approximation techniques
  • Familiarity with polynomial ratios in approximation
  • Knowledge of spline curve fitting and knot placement
  • Basic concepts of Legendre polynomials
NEXT STEPS
  • Research "function approximation" methodologies
  • Explore "approximation by rational functions" techniques
  • Learn about "automatic knot placement" for spline fitting
  • Study the application of "Legendre polynomials" in data expansion
USEFUL FOR

Data scientists, mathematicians, and engineers involved in numerical analysis, particularly those working on data approximation and functional expansions in large datasets.

laxsu19
Messages
13
Reaction score
1
Hi all,

I am trying to figure out 1) What to call my problem so I can better research the literature, and 2) see if anyone here knows of a solution.

Essentially, I have a large set of f(x) vs x points (~20,000) which I need to split into subdomains in x, and within each subdomain calculate a functional expansion of f(x). I want to do this in an optimal manner such that 1) the number of subdomains is minimized - or at least manageable, and 2) the number of expansion orders (probably Legendre) within each subdomain is also minimized.

Does anyone have any idea what 'field' of math this could be considered, and where to begin searching around? Unfortunately, this is just a minor step in what I have to do so I don't want to expend much effort here.

Thanks for your help!
 
Physics news on Phys.org
Does your data contain "noise" or is the data simply known values of some precisely defined function? If your data is known values of a precisely defined function, then the general topic to research is "function approximation". For many functions, the simplest approximations (for a given mean square error) are done by using ratios of polynomials. That topic is "approximation by rational functions".
 
If you can fit each subdomain by a low order polynomial, some buzzwords are automatic knot placement for spline curve fitting. (The "knots" are the points at the end of each subdomain, i.e. the end of each spline segment).
 
If there are an infinite number of natural numbers, and an infinite number of fractions in between any two natural numbers, and an infinite number of fractions in between any two of those fractions, and an infinite number of fractions in between any two of those fractions, and an infinite number of fractions in between any two of those fractions, and... then that must mean that there are not only infinite infinities, but an infinite number of those infinities. and an infinite number of those...

Similar threads

  • · Replies 37 ·
2
Replies
37
Views
5K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 13 ·
Replies
13
Views
2K
  • · Replies 3 ·
Replies
3
Views
3K
Replies
28
Views
4K
  • · Replies 4 ·
Replies
4
Views
2K
  • · Replies 3 ·
Replies
3
Views
1K
  • · Replies 5 ·
Replies
5
Views
4K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 1 ·
Replies
1
Views
1K