Convergence order of central finite difference scheme

Click For Summary

Discussion Overview

The discussion centers on the convergence order of the central finite difference scheme when applied to the 1D Poisson equation. Participants explore the relationship between the order of convergence for the numerical solution and the order of approximation for derivatives, particularly focusing on the implications of using a three-point stencil in finite difference methods.

Discussion Character

  • Exploratory
  • Technical explanation
  • Debate/contested
  • Mathematical reasoning

Main Points Raised

  • Some participants discuss why the three-point central difference scheme is considered a second-order method for solution convergence, despite the approximation of derivatives being second order.
  • Others question the relationship between the convergence order of the numerical solution and the truncation error associated with derivative approximations.
  • A participant provides a detailed example involving B-spline functions and compares convergence orders across different numerical methods, noting that the Galerkin method achieves full convergence order while the collocation method does not.
  • Some participants express confusion about how the convergence of the finite difference method relates to the convergence of the discretization error for boundary value problems.
  • One participant mentions that in their experience with various PDEs, the solutions using central differences consistently converged with second-order accuracy.

Areas of Agreement / Disagreement

Participants generally do not reach consensus on the relationship between the order of convergence for the finite difference method and the polynomial order of the basis functions used in other methods. Multiple competing views remain regarding the implications of using different numerical schemes and their convergence properties.

Contextual Notes

Participants highlight that the discussion involves various assumptions about the regularity of solutions and the nature of the numerical methods being compared, which may affect convergence behavior. There is also mention of potential order reduction in finite difference methods compared to other approaches like Galerkin FEM.

lmal
Messages
6
Reaction score
0
For example, when we solve simple 1D Poisson equation by finite difference method, why three point central difference scheme on uniform grid (attached image) is second order method for solution convergence?

I understand why approximation of first derivative is second order (and that second derivative is also second order because cancelation of first order truncation error term on uniform grid), but I don’t understand why solution also converges with second order.

Basically, this approximation is equivalent to fitting local quadratic (p=2) polynomial through three points which should theoretically yield third (p+1) order method?
 

Attachments

  • Capture.PNG
    Capture.PNG
    1.6 KB · Views: 952
Physics news on Phys.org
lmal said:
I don’t understand why solution also converges with second order.
What is the differential equation that you are solving and what numerical scheme are you using?

A finite difference is just an approximation of a derivative. By replacing the derivatives in a partial differential equation with their finite difference representations, you will get a large system of simultaneous equations. A classic example of this is the four point stencil for the two dimensional Laplace equation. This will produce a sparse diagonally banded matrix which can be solved very quickly using successive over-relaxation (SOR). There are other PDEs however, where finite difference approximations don't produce a system that is easy to solve. Non-linear PDE's are an obvious example since the system of equations cannot be cast as a matrix equation.
 
Thx NFuller, but that wasn't what I had in mind. Here are some more details.
I used example of linear 1D Poisson equation (smooth exact solution) and compared convergence of few numerical methods with different order of basis (interpolation) functions. I used B-spline functions as basis functions. Order of convergence was determined for each method and each basis function by plotting graph "dx - error norm" in log-log scale and slope of the curve determines convergence order of method.
Theoretically convergence order depends of polynomial order of basis function (Taylor series expansion), and for Galerkin method (classical FEM) there is full convergence order, i.e. if "p" is order of basis function than solution converges with order "p+1", while first derivative converges with order "p" and second derivative with order "p-1". For collocation method that is not case and there is reduction in convergence order. Now I'm trying to figure way.
So I used also Finite difference method (FDM) with 3 point stencil which is equivalent to approximation of second derivative by local polynomial of order p=2 (i.e. quadratic) and solution converges with order 2. By looking into Taylor expansion it is clear that first derivative approximation converges with order 2, and that second derivative converge also with order 2 (for uniform/symmetric grid and even-order polynomials as in this case). Now I'm looking for more detailed explanation why central difference scheme on three point stencil has same convergence order for solution as for first two derivatives.
 
$$f(x+\Delta x)=f(x)+f'(x)\Delta x+f''(x)\frac{(\Delta x) ^2}{2}+f'''(x)\frac{(\Delta x)^3}{6}+f''''(x)\frac{(\Delta x)^4}{24}$$
$$f(x-\Delta x)=f(x)-f'(x)\Delta x+f''(x)\frac{(\Delta x) ^2}{2}-f'''(x)\frac{(\Delta x)^3}{6}+f''''(x)\frac{(\Delta x)^4}{24}$$
$$\frac{f(x+\Delta x)-2f(x)+f(x-\Delta x)}{(\Delta x)^2}=f''(x)+f''''(x)\frac{(\Delta x)^2}{12}$$
 
Thx, Chestermiller, but I'm interested how can I relate this with convergence of discretization error for approximation of boundary value problem with FDM, i.e., convergence order of numerical solution, and not truncation error for approximation of derivative.
 
lmal said:
Thx, Chestermiller, but I'm interested how can I relate this with convergence of discretization error for approximation of boundary value problem with FDM, i.e., convergence order of numerical solution, and not truncation error for approximation of derivative.
In my judgment (and experience), it really boils down to the same thing.
 
I have posted same question here:
https://www.cfd-online.com/Forums/m...e-point-central-finite-difference-scheme.html

If we use classical Galerkin FEM and quadratic Lagrangian polynomials we will get that solution converges by order 3. If we differentiate numerical solution and compare with exact first derivative of solution we will get that 1st derivative converges by order 2, and 2nd derivative will converge with order 1. It means that in Galerkin FEM convergence order depends directly on order of Lagrangian polynomial (I am assuming ideal case when solution is sufficiently regular).

Now I'm trying to relate this with convergence of FDM. Apparently we are dealing with quadratic polynomial (or even of degree 4; because of symmetry for second derivative approximation) but our FDM is only 2nd order method. I can't figure why. I know that collocation method for same basis function will have reduced order when compared with Galerkin.

Is there some order reduction in FDM because its nature of approximation?
 
I don't know how to answer this except to say that I have solved many, many, many PDE's (parabolic, elliptic, Poisson) in my day using central differences for the spatial derivatives (FDM), and have always found that the solutions converged with 2nd order accuracy in the spatial increments. That is, the errors were of order ##(\Delta x)^2##.
 
  • Like
Likes   Reactions: lmal

Similar threads

  • · Replies 2 ·
Replies
2
Views
3K
  • · Replies 1 ·
Replies
1
Views
1K
  • · Replies 2 ·
Replies
2
Views
4K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 2 ·
Replies
2
Views
3K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 6 ·
Replies
6
Views
3K
Replies
3
Views
6K
  • · Replies 2 ·
Replies
2
Views
3K