Computing derivatives/integrals of user-defined functions

Click For Summary

Discussion Overview

The discussion revolves around methods for computing derivatives and integrals of user-defined functions, focusing on both numerical and symbolic approaches. Participants explore coding strategies and share insights on implementing these methods, particularly in programming languages like C and Python.

Discussion Character

  • Technical explanation
  • Mathematical reasoning
  • Debate/contested

Main Points Raised

  • Some participants suggest using a numerical approach, such as the secant method, to approximate derivatives by evaluating the function at points around the desired value.
  • Others propose a symbolic approach that involves tokenizing expressions and applying differentiation rules recursively, mentioning the need for a parser to handle user-defined functions.
  • A participant shares a C code snippet intended for differentiation but expresses confusion about its correctness and the symbolic approach.
  • Another participant critiques the provided C code, highlighting issues such as incorrect return values, type usage, and the need for function pointers to handle functions as arguments.
  • There is mention of using higher-level languages like Python for easier implementation of differentiation functions, contrasting it with the complexities of C.
  • Some participants note that symbolic differentiation is more complex and may require a data structure like a tree to represent expressions, along with recursive functions for differentiation.

Areas of Agreement / Disagreement

Participants present multiple competing views on the best approach to compute derivatives, with no consensus reached on a single method. There is also disagreement on the effectiveness of the provided C code and the challenges of implementing symbolic differentiation.

Contextual Notes

Limitations include the complexity of symbolic differentiation in C, the potential for errors in function implementations, and the need for a deeper understanding of function pointers and data structures.

clope023
Messages
990
Reaction score
130
does anyone have ideas or easy to read versions of code for this? I was looking for ways to do it using the limit definition of a derivative of a function and I've found a few applets but nothing that is that clear; any ideas are appreciated.
 
Technology news on Phys.org
In general, you can adopt an approximate numerical approach, or an exact symbolic approach.

In the numerical approach, all you need to do is have some way of evaluating a user-defined function for a given value of x. You could write this by yourself (you would have to write a parser that would recognize well-formatted expressions, like a calculator), or you could use already existing code (you should be able to find lots of this kind of thing). So I enter

f(x) = 2*x + (exp(-3*x+2)) and I want f '(3)...

You approximate the derivative using the secant method. Basically,

f '(3) ~ f(3 + d) - f(3 - d) / 2d

You will want to play around with the value of d, but that's about all there is to it.The symbolic approach, on the other hand, will change everything to tokens, and recursively differentiate the tokens. The base cases will consist of polynomial expressions, sines and cosines, exponentials, etc. Then just build into the interpreter the properties of differentiation - you know, like the product, chain, quotient, power, etc. rules - and then you can change the user function into a new function.

Then you can just evaluate the derivative function at the desired point.

The answer to your question depends on which strategy you find more appealing.
 
csprof2000 said:
In general, you can adopt an approximate numerical approach, or an exact symbolic approach.

In the numerical approach, all you need to do is have some way of evaluating a user-defined function for a given value of x. You could write this by yourself (you would have to write a parser that would recognize well-formatted expressions, like a calculator), or you could use already existing code (you should be able to find lots of this kind of thing). So I enter

f(x) = 2*x + (exp(-3*x+2)) and I want f '(3)...

You approximate the derivative using the secant method. Basically,

f '(3) ~ f(3 + d) - f(3 - d) / 2d

You will want to play around with the value of d, but that's about all there is to it.


The symbolic approach, on the other hand, will change everything to tokens, and recursively differentiate the tokens. The base cases will consist of polynomial expressions, sines and cosines, exponentials, etc. Then just build into the interpreter the properties of differentiation - you know, like the product, chain, quotient, power, etc. rules - and then you can change the user function into a new function.

Then you can just evaluate the derivative function at the desired point.

The answer to your question depends on which strategy you find more appealing.

interesting, this is what I tried to write for a derivative function but it gave me a 0 so obviously it wasn't correct (in C)

int diff(int function, int h)
{
function = ((function+h)-function)%h;
return 0;
}

you'll have to forgive me but I'm not following how the symbolic approach is done
 
clope023 said:
Code:
int diff(int function, int h)
{
function = ((function+h)-function)%h;
return 0;
}

Several issues:

* That function returns 0.
* It has integer types, where you probably want to use a floating-point type like 'float' or 'double'.
* '%' is a modulus operator; '/' is division
* Your 'function' argument is of integer type ('int'), not function type. It is a number, not a function of a number.

The last issue is most significant, and problematic. You will, unfortunately, need to use C's function pointers to implement these kinds of things, functions which take functions as arguments. You will probably want to look this up in whatever C reference you have. For example, differentiation:

Code:
double diff(double (*f)(double), double x, double dx) {
  return ((*f)(x + dx) - (*f)(x)) / dx;
};

Or you can hack together a macro, which is somewhat simpler:

Code:
#define diff(f, x, dx) ((f((x)+(dx)) - f(x))/(dx))

Both approaches are difficult and dangerous (in the sense, it is easy to make errors and not be able to find them). The C language was not designed to support this type of programming. If you know any high-level languages, it becomes much easier. Python, for instance - very easy-to-use, easy-to-learn language:

Code:
def diff(f, x, dx):
   return (f(x+dx) - f(x)) * 1.0 / dx

(Note the lack of type annotations - Python will infer that f is a function, and x and dx are numbers. The 1.0 is there to coerce floating point division, as opposed to integer division with rounding.)

Symbolic differentiation is much harder. To implement it in C, you will need to figure out a way to represent the structure of a symbolic expression as a C data structure (probably a tree, made with pointers). Then you will need to write a function to differentiate such an expression, probably acting recursively - taking the expression, breaking it up, differentiating the parts, and combining them using (e.g.) the product rule.

However, it is easier if you use a symbolic programming language, like the educational language Scheme. For example, there is a worked example of symbolic differentiation in chapter 2 of the free book "Structure and Interpretation of Computer Programs". It's not particularly easy, but if you're motivated...

http://mitpress.mit.edu/sicp/
 
Last edited:

Similar threads

  • · Replies 63 ·
3
Replies
63
Views
5K
  • · Replies 7 ·
Replies
7
Views
3K
  • · Replies 5 ·
Replies
5
Views
2K
  • · Replies 11 ·
Replies
11
Views
3K
Replies
3
Views
2K
  • · Replies 15 ·
Replies
15
Views
3K
  • · Replies 32 ·
2
Replies
32
Views
5K
  • · Replies 11 ·
Replies
11
Views
2K
  • · Replies 17 ·
Replies
17
Views
3K
  • · Replies 41 ·
2
Replies
41
Views
5K