Yes, I understand that. However the problem is that at some point along your process you will HAVE to evaluate f ' (x) or f '' (x) at some point, correct? and, unless f(x) is linear, this will just give a rough approximation (and sometimes completely inaccurate).
Say f ' (x) = 2x^2+1, we want to find the secant line from -1 to 1. evaluating at the two points one gets f ' (-1)= 3 and f ' (1) = 3 We take f ' (0) = 1, however this is just one small part of the larger picture of the function. so let's say my original function was f(x)=(2/3)x^3+x+c (found by integration), so the secant line has a slope of
del(y)/del(x) = (5/3-(-5/3))/2 = 10/6
which is CLOSE to 1, but not percise. What we could do perhaps is take f ' (-1/3) and f ' (1/3) and average them and perhaps you would get a little closer, and then divide it again and again. But the limit of this process is just the integral.
does that help to explain anything? or am i misunderstanding your theory?