How Can We Ensure Convergence in Function Approximations Beyond Taylor Series?

In summary: Taylor expansion. What do you say?No, the scheme may diverge because of the differential equation you are trying to solve. There is no general answer to this. If you want to know how to show that a certain differential equation is "well-posed", you need to study the subject, and learn how to prove well-posedness.
  • #1
mertcan
345
6
Hi, as you know infinite sum of taylor series may not converge to its original function which means when we increase the degree of series then we may diverge more. Also you know taylor series is widely used for an approximation to vicinity of relevant point for any function. Let's think about a function which is infinitely differentiable so infinitely taylor series exist but it is so complicated function that we can not apply ratio test to find radius of convergence or integral test analytically...In short how we can approximate to any function with a guaranteed convergence except taylor series expansion?
 
Mathematics news on Phys.org
  • #2
There are no guarantees.
 
  • #3
mertcan said:
as you know infinite sum of taylor series may not converge to its original function
Enlighten us ... :rolleyes:

mertcan said:
Let's think about a function which is infinitely differentiable so infinitely taylor series exist but it is so complicated function that we can not apply ratio test to find radius of convergence or integral test analytically
Can you give an example ? Is there something specific you have in mind ?
 
  • #4
I'm curious. Is this a homework question, or just something to ponder?
 
  • #5
Hi, I would like to express: Taylor series expansion is widely used in Finite Element methods for instance to set the relation between nodes. I agree to use Taylor expansion in finite difference schemes to approximate to a node from another node but I have not seen any case that Taylor series used in schemes are controlled in terms of convergence. Taylor expansion may converge or not to its original function which means you may diverge more when you increase the degree of Taylor series expansion but in FEM it is always said that Taylor expansion gets more accurate and thus scheme gets more precise when expansion degree increases although there is not a convergence check for taylor expansion. Could you enlighten me about that? Why convergence of taylor expansion between nodes in finite difference schemes are not checked?
 
  • #6
[Moderator note: The OP reprhased his question, and created a second thread. I merged that back into this thread.]

@mertcan , Please think about and respond to the replies you have rather than ignore them and repost the same question.
 
  • Like
Likes BvU
  • #7
@BvU @mathman @scottdave what are your thoughts about my last question which also involve Finite element method?
 
  • #8
mertcan said:
@BvU @mathman @scottdave what are your thoughts about my last question which also involve Finite element method?
Sorry: I have had no experience with FEM so I can't give any useful comment here.
 
  • #9
[Moderator note: this thread was moved here from the Calculus forum.]
 
  • #10
Let me ask my question in post 5 in that way: If we expand Taylor series of infinitely differentiable function then we may diverge because of the fact that derivative at infinity may be infinite or unbounded. Convergence tests I have seen so far are always capable of reflecting the formula of coefficients of power series at infinity in short we know what the coefficients will be at infinity. Taylor series could be considered also as a power series whose coefficients are derivatives of function but we may not know the formula of derivatives (coefficients of power series) at infinity. So how can we find out the radius of convergence of relevant function whose derivatives are not known at infinity in Taylor series expansion?
 
  • #11
Are you asking whether there exist differential equations for which higher order numerical methods do not perform well?

Yes this is certainly true.

mertcan said:
In short how we can approximate to any function with a guaranteed convergence
We can't. There are some functions which are difficult to integrate numerically,

mertcan said:
in FEM it is always said that Taylor expansion gets more accurate and thus scheme gets more precise when expansion degree increases
Who always says this? I do not agree with them. Sometimes a higher-order method is better, sometimes you are better off with smaller steps, sometimes round-off error is the limiting factor and you need to use other methods...
 
  • #12
pbuk said:
Are you asking whether there exist differential equations for which higher order numerical methods do not perform well?

Yes this is certainly true.We can't. There are some functions which are difficult to integrate numerically,Who always says this? I do not agree with them. Sometimes a higher-order method is better, sometimes you are better off with smaller steps, sometimes round-off error is the limiting factor and you need to use other methods...
Thans for return @pbuk. Could I get your valuable response to my following question also I mentioned in post 10 :Taylor series could be considered also as a power series whose coefficients are derivatives of function but we may not know the formula of derivatives (coefficients of power series) at infinity. So how can we find out the radius of convergence of relevant function whose derivatives are not known at infinity in Taylor series expansion?
 
  • #13
mertcan said:
So how can we find out the radius of convergence of relevant function whose derivatives are not known at infinity in Taylor series expansion?
We can't, so we use other methods to estimate the accuracy of our numerical method, or detect if it is unstable.
 
  • #14
pbuk said:
We can't, so we use other methods to estimate the accuracy of our numerical method, or detect if it is unstable.
Thanks for response...I have 2 things to say @pbuk: 1) what methods you mentioned are employed to estimate the accuracy of our numerical method?
2) As far as I know, Von neumann stability analysis or other similar stability analysis consider the explosiveness of finite difference scheme just with respect to time( to prevent divergence situation just over time not grid size...). If we think of that time is frozen and only coordinate or grid size terms are left then scheme may diverge because of divergence of Taylor expansion. What do you say?
 
Last edited:
  • #15
mertcan said:
1) what methods you mentioned are employed to estimate the accuracy of our numerical method?
I think this is my last post on this topic because you should be able to find out answers in whatever sources you are using to learn from, but here we go with some google searches as a substitute...
https://www.google.com/search?q=boundary+value+problem+error+estimation
mertcan said:
2) As far as I know, Von neumann stability analysis or other similar stability analysis consider the explosiveness of finite difference scheme just with respect to time( to prevent divergence situation just over time not grid size...).
https://www.google.com/search?q=von+neumann+stability+analysis+finite+difference+methodsOr this one looks like 185 pages of good stuff: https://people.maths.ox.ac.uk/trefethen/4all.pdf
Or Chapters 8-10 of Numerical Computation of Internal External Flows Vol 1 (Hirsch) - this seems to be available on the web but I am not sure about copyright so I won't provide a link.
 
  • #16
pbuk said:
I think this is my last post on this topic because you should be able to find out answers in whatever sources you are using to learn from, but here we go with some google searches as a substitute...
https://www.google.com/search?q=boundary+value+problem+error+estimationhttps://www.google.com/search?q=von+neumann+stability+analysis+finite+difference+methodsOr this one looks like 185 pages of good stuff: https://people.maths.ox.ac.uk/trefethen/4all.pdf
Or Chapters 8-10 of Numerical Computation of Internal External Flows Vol 1 (Hirsch) - this seems to be available on the web but I am not sure about copyright so I won't provide a link.
Thanks @pbuk,I would like to ask a little question about stability analysis: In order to ensure von neumann stability analysis, we may have $$a*\frac {\Delta_t} {\Delta_x} < 1$$ for a finite difference scheme whereas a is constant. I deem that even if we provide stability analysis our solution may not be consistent in terms of taylor expansion. For instance say that $$\Delta_t <<<<<<<< 1$$ and $$\Delta_x = 10000000$$ Here stability is ensured but due to the fact that grid size ,which means Delta_x, is so large than taylor expansion tends to diverge. In short stability results are not useful to obtain consistent or convergent taylor expanison therefore what else can we do to have right grid size which lead to convergent taylor expanison?
 
  • #17
mertcan said:
Thanks @pbuk,I would like to ask a little question about stability analysis: In order to ensure von neumann stability analysis, we may have $$a*\frac {\Delta_t} {\Delta_x} < 1$$ for a finite difference scheme whereas a is constant. I deem that even if we provide stability analysis our solution may not be consistent in terms of taylor expansion. For instance say that $$\Delta_t <<<<<<<< 1$$ and $$\Delta_x = 10000000$$ Here stability is ensured but due to the fact that grid size ,which means Delta_x, is so large than taylor expansion tends to diverge. In short stability results are not useful to obtain consistent or convergent taylor expanison therefore what else can we do to have right grid size which lead to convergent taylor expanison?
@pbuk what do you consider about my last post?
 
  • #18
mertcan said:
@pbuk what do you consider about my last post?
What do you consider about your last post? If you can learn about ## \Delta t ## by investigating the partial deriviative with respect to ## t ##, how do you think you can learn about ## \Delta x ##?
 
  • #19
pbuk said:
What do you consider about your last post? If you can learn about ## \Delta t ## by investigating the partial deriviative with respect to ## t ##, how do you think you can learn about ## \Delta x ##?
@pbuk I just would like to emphasise that stability analysis results mostly gives an interval including ## \Delta t ## and ## \Delta x ## . And I deem that in FEM we try to have stable system according to values which obey the interval, so as long as we have consistency with stability I consider we can choose whatever the ## \Delta x ## or ## \Delta t ## is. But Even if we have stability we may diverge in terms of taylor series right? Could you help me about that confusion?
 
  • #20
I always see that taylor expansion usage is so pervasive in finite element/difference method. Actually it implies that if taylor expansion is employed then it must be accepted that all derivatives of function need to be bounded to be convergent to original function. What should be done in FEM or FDM if derivatives of function may be unbounded? or Is it possible to have a function in FEM or FDM with unbounded derivative?
 
  • #21
mertcan said:
I always see that taylor expansion usage is so pervasive in finite element/difference method. Actually it implies that if taylor expansion is employed then it must be accepted that all derivatives of function need to be bounded to be convergent to original function. What should be done in FEM or FDM if derivatives of function may be unbounded? or Is it possible to have a function in FEM or FDM with unbounded derivative?
@pbuk also May I get your valuable comments?
 
  • #22
The convergence of Taylor series can only be well understood when the complex plane is considered. When they converge, their behavior is very good and it possesses desirable properties. There are other series, like Fourier series, which converge for more functions on a segment of the real line. And there are integral representations that are useful for even more functions on the real line (see Fourier inversion theorem ).
 
  • Like
Likes mertcan
  • #23
mertcan said:
@pbuk also May I get your valuable comments?

mertcan said:
What should be done in FEM or FDM if derivatives of function may be unbounded?
Use a smaller grid.

This thread is going in circles.
 
  • Like
Likes mertcan
  • #24
pbuk said:
This thread is going in circles.
Thread closed. Thanks for your participation.
 

Related to How Can We Ensure Convergence in Function Approximations Beyond Taylor Series?

1. What is a Taylor Series?

A Taylor Series is a mathematical representation of a function as an infinite sum of terms that are calculated from the values of the function's derivatives at a single point.

2. How is a Taylor Series used to approximate a function?

A Taylor Series can be used to approximate a function by adding together a finite number of terms from the series. The more terms that are included, the closer the approximation will be to the actual function.

3. What is meant by the "radius of convergence" of a Taylor Series?

The radius of convergence of a Taylor Series is the distance from the center point at which the series is guaranteed to converge. It is typically represented by the variable "R" and can be calculated using the ratio test.

4. What are some common ways to test for the convergence of a Taylor Series?

Some common tests for the convergence of a Taylor Series include the ratio test, the root test, and the alternating series test. These tests can help determine if the series will converge or diverge at a specific point.

5. Can a Taylor Series converge at one point and diverge at another?

Yes, it is possible for a Taylor Series to converge at one point and diverge at another. The convergence of a Taylor Series depends on the function being approximated and the point at which it is being evaluated. It is important to check the radius of convergence and use other tests to determine the convergence of a series at a specific point.

Similar threads

Replies
3
Views
1K
  • General Math
Replies
7
Views
1K
Replies
3
Views
1K
Replies
3
Views
1K
Replies
19
Views
2K
Replies
16
Views
4K
  • Calculus and Beyond Homework Help
Replies
2
Views
394
  • Calculus and Beyond Homework Help
Replies
2
Views
1K
Replies
7
Views
1K
Back
Top