the fundamental theorem of calculus says that the two operations of differentiation and integration are inverse to each other. This is two statements:
1) the derivative of the integral of g is g, and
2) the integral of the derivative of f is f, (up to a constant).
These have different hypotheses. The first one is true for any continuous g, but not for every integrable g. E.g. if g is a step function, then its integral is continuous but only differentiable away from the points where the steps jump up. I general, an integrable function is continuous except on a thin set (a set of measure zero). Then its integral is not just continuous but Lifschitz continuous everywhere. It is differentiable wherever the integrand was continuous, i.e. off the measure zero set. Hence on this measure zero set it may not make sense even to ask whether the derivative of the integral equals the original function. Even if it is differentiable the derivative may differ from the original function where that one is not continuous.
E.g. the Dirichlet function, equal to zero at all irrationals, and equal to 1/q at a rational with p.q relatively prime, is integrable with integral zero. Hence the derivative of the integral is differentiable everywhere but only equals the original function at irrationals.
The second part of the theorem is more delicate still. If f is Lipschitz continuous, then f is differentible except on a set of measure zero, but it is not clear at least to me whether the derivative can be extended to an integrable function. If we assume also that the derivative of f has an integrable extension g however, then I believe the integral of g does equal f(x)-f(a).
However if f is only continuous with a derivative almost everywhere that is integrable, there is no reason for that integral to be anywhere at all like the original function. E.g. the Cantor function is continuous and increases weakly monotonically from 0 to 1, but its derivative equals 0 almost everywhere. Thus the integral is also zero.
The usual statements of part 2) have stronger hypotheses. One either assumes the derivative g of f exists everywhere and is integrable, and then the mean value theorem applied to Riemann sums implies the integral of g equals f(x)-f(a).
Or else one assumes that f actually has a continuous derivative g everywhere, and then g is integrable and has integral equal to f(x)-f(a). The proof is that f and the integral of g have the same derivative. Then it follows from the MVT that they differ only by a constant.
Thus the simplest statement is that if we consider two classes of functions on [a,b], C = continuous functions, and C^1 = differentiable functions with continuous derivative, then differentiation and integration are inverse operations on these two classes. I.e. if I:C-->C^1 is integration, and if D:C^1-->C is differentiation, then DIg = g, and IDf = f-f(a) Thus I is right inverse to D. In particular D is surjective and I is injective. I.e. every continuous g has a C^1 antiderivative, in fact many, and the operation I selects one of these, the one with value zero at a.