Dismiss Notice
Join Physics Forums Today!
The friendliest, high quality science and math community on the planet! Everyone who loves science is here!

Differentiation of an integral

  1. Jul 21, 2004 #1


    User Avatar
    Science Advisor
    Homework Helper

    Physicists do it all the time: interchanging limits, assuming uniform convergence, differentiation a delta function..
    Usually it's all valid, but I'd like to see when we can interchange differentiation with respect to one variabele with integration over another.
    It seems the following theorem exists:

    [tex]\frac{d}{dy}\int_{x_1(y)}^{x_2(y)}f(x,y)dx=f(x_2,y)\frac{dx_2}{dy}-f(x_1,y)\frac{dx_1}{dy}+\int_{x_1(y)}^{x_2(y)}\frac{\partial f}{\partial y}dx[/tex]
    So when the boundaries do not depend on [tex]y[/tex] we may simply bring the derivative under the integral sign.

    I couldn't find a proof of this so I set out to prove it myself.
    I'd like to know if I made any mistakes.

    Let [tex]G(x,y)=\int^xf(x',y)dx'[/tex].
    So that [tex]\frac{\partial G}{\partial x}=f(x,y)[/tex]
    Using this we have:

    (1) [tex]\int_{x_1(y)}^{x_2(y)}\frac{\partial f}{\partial y}dx= \int_{x_1(y)}^{x_2(y)}\frac{\partial^2 G}{\partial y \partial x}dx= \int_{x_1(y)}^{x_2(y)}\frac{\partial^2 G}{\partial x \partial y}dx=[/tex]
    [tex]\int_{x_1(y)}^{x_2(y)}\frac{\partial}{\partial x}\left(\frac{\partial G}{\partial y}\right)dx= \frac{\partial G}{\partial y}(x_2(y),y)-\frac{\partial G}{\partial y}(x_1(y),y)=[/tex]
    [tex] \frac{\partial}{\partial y}\left(\int^{x_2(y)}f(x,y)dx-\int^{x_1(y)}f(x,y)dx\right)=\frac{\partial}{\partial y}\int_{x_1(y)}^{x_2(y)}f(x,y)dx[/tex]

    Which is pretty close. Actually, I realized I need total differentiation with respect to y, not partial differentiation. So I can use:

    [tex]\frac{d}{dy}(G(x_2(y),y)-G(x_1(y),y))=\frac{\partial G}{\partial x_2}\frac{dx_2}{dy}+\frac{\partial G}{\partial y}(x_2,y)-\frac{\partial G}{\partial x_1}\frac{dx_1}{dy}-\frac{\partial G}{\partial y}(x_1,y)[/tex]
    Which is equal to
    [tex]\left(\frac{\partial}{\partial x_2}\int^{x_2(y)}f(x,y)dx\right)\frac{dx_2}{dy}-\left(\frac{\partial}{\partial x_1}\int^{x_1(y)}f(x,y)dx\right)\frac{dx_1}{dy}+[/tex]
    [tex]\frac{\partial}{\partial y}\int_{x_1(y)}^{x_2(y)}f(x,y)dx[/tex]

    Which is the right answer if
    [tex]\frac{\partial}{\partial x_2}\int^{x_2(y)}f(x,y)dx=f(x_2(y),y)[/tex]
    But I`m not sure if this is true. I know that
    [tex]\frac{d}{dx}\int^xf(x)dx=f(x)[/tex], but I`m not sure if I can use that here. Furthermore, we need:

    [tex]\int_{x_1(y)}^{x_2(y)}\frac{\partial}{\partial x}\left(\frac{\partial G}{\partial y}\right)dx= \frac{d}{dy}(G(x_2(y),y)-G(x_1(y),y))[/tex]
    instead of partial differentiation.

    Can anyone give me pointers please???
  2. jcsd
  3. Jul 21, 2004 #2
    I didn't know it was possible to get away with only one limit of integration:


    Can you explain?
  4. Jul 21, 2004 #3
    The main step in your derivation is the application of "multivariate chain rule". In fact what you are doing is treating [tex]G(x_i(y),y)[/tex] as [tex]G\circ f [/tex], where f is the function [tex]y\rightarrow(x_i(y), y)[/tex]. So you asked if "[tex]\frac{\partial}{\partial x_2}\int^{x_2(y)}f(x,y)dx=f(x_2(y),y)[/tex]" is correct. In fact, in this step, you do not even need to consider [tex]x_2(y)[/tex] as a function of y. You only need to consider it as an independent variable. (For example, consider how you would differentiate [tex]f\circ g [/tex], where f is [tex](x,y)\rightarrow x^{2}y^{2} [/tex] and g is [tex]t\rightarrow (x_1(t), t) [/tex])

    So, given your intermediate mapping [tex]f: y\rightarrow(x_i(y), y)[/tex], your proposition is true. Note that it may not be true if you choose another intermediate mapping.

    And also, it is better to put a lower limit to [tex]\int^{x_2(y)}f(x,y)dx[/tex], like [tex]\int^{x_2(y)}_{a}f(x,y)dx[/tex], where a is an arbitrary constant.
    Last edited: Jul 21, 2004
  5. Jul 22, 2004 #4
    Galileo wanted to show that

    [tex]\frac{d}{dy}\int_{x_1(y)}^{x_2(y)}f(x,y)dx=f(x_2,y)\frac{dx_2}{dy}-f(x_1,y)\frac{dx_1}{dy}+\int_{x_1(y)}^{x_2(y)}\frac{\partial f}{\partial y}dx[/tex]

    so he went ahead and said let:




    So from what Galileo found,


    [tex]\left(\frac{\partial}{\partial x_2}\int^{x_2(y)}f(x,y)dx\right)\frac{dx_2}{dy}-\left(\frac{\partial}{\partial x_1}\int^{x_1(y)}f(x,y)dx\right)\frac{dx_1}{dy}+[/tex]
    [tex]\frac{\partial}{\partial y}\int_{x_1(y)}^{x_2(y)}f(x,y)dx[/tex]

    and as Wong noted, this simplifies to

    [tex]\frac{\partial}{\partial y}\int_{x_1(y)}^{x_2(y)}f(x,y)dx[/tex]

    So the question I think is not whether

    but rather that

    [tex]\frac{\partial}{\partial y}\int_{x_1(y)}^{x_2(y)}f(x,y)dx=\int_{x_1(y)}^{x_2(y)}\frac{\partial f}{\partial y}dx[/tex]

    So, is this the case?
  6. Jul 22, 2004 #5
    I think it is the case "if" f(x,y) has continuous derivatives. It is well known that if f(x,y) has continuous derivatives then one can "exchage the operation of integration and (partial) differentiation".

    In fact, I think the formula may (I am not sure...) be proved by first breaking down [tex]\int_{x_1(y)}^{x_2(y)}f(x,y)dx[/tex] into [tex]\int_{a}^{x_2(y)}f(x,y)dx - \int_{a}^{x_1(y)}f(x,y)dx[/tex]. Then for each integral, treat it as a composition of mappings that I mentioned in the previous post and differentiate it using chain rule. Using the fact that "the operation of integration and (partial) differentiation may be exchanged for function with continuous derivatives", one may obtain the result.
    Last edited: Jul 22, 2004
  7. Jul 22, 2004 #6
    I have forgotten this and can't find a proof in the books I have at home, mind sketching one?


  8. Jul 22, 2004 #7
    Sorry, the condition should be for f(x,y) with continuous derivatives. It is pretty obvious since otherwise [tex]\frac{\partial}{\partial y}f(x,y)[/tex] may not even exist...sorry for the confusion.
  9. Jul 22, 2004 #8


    User Avatar
    Science Advisor
    Homework Helper

    Man! I can't believe this problem got me stumped, while the solution is that close.

    The lower limit of integration doesn't matter. All I wanted was to get a general expression for an antiderivative of f with respect to x. You can put a constant in there if you want, but all that matters is the derivative of G.

    That is what I wanted to prove. I used Clairaut's theorem for G, so that

    [tex]\frac{\partial^2 G}{\partial y \partial x}=\frac{\partial^2 G}{\partial x \partial y}[/tex]
    Which is true if G has continous partial derivatives. That is: when f is continuous.

    Now the result is established if the following holds:
    [tex]\int_{x_1(y)}^{x_2(y)}\frac{\partial}{\partial x}\left(\frac{\partial G}{\partial y}\right)dx= \frac{d}{dy}(G(x_2(y),y)-G(x_1(y),y))[/tex]
    and if (as Wong said) this simplifies to the answer.

    In my first post I showed that
    [tex]\frac{\partial}{\partial y}\int_{x_1(y)}^{x_2(y)}f(x,y)dx=\int_{x_1(y)}^{x_ 2(y)}\frac{\partial f}{\partial y}dx[/tex]
    (See the (1) sign in my first post)

    So the result is established right??? :confused:
  10. Jul 22, 2004 #9


    User Avatar
    Science Advisor
    Homework Helper
    Gold Member
    Dearly Missed




    Hence, we have:

    which goes to the limit: [tex]f(x_{2}(y),y)\frac{dx_{2}}{dy}[/tex]

    By using the appropriate expression for [tex]R_{1}[/tex] the other terms may be found in a similarly laborious way
  11. Jul 22, 2004 #10


    User Avatar
    Science Advisor
    Homework Helper

    Alright! I think we got it. I`m convinced that indeed
    [tex]\frac{\partial}{\partial x_2}\int^{x_2(y)}f(x,y)dx=f(x_2(y),y)[/tex]
    holds generally, since:
    [tex]\frac{\partial G}{\partial x}=f(x,y)[/tex]
    it shouldn`t matter what letter we use for the first variable, so that
    [tex]\frac{\partial G}{\partial x_2}=f(x_2,y)[/tex]

    Now we have:
    [tex]\frac{d}{dy}\int_{x_1(y)}^{x_2(y)}f(x,y)dx=f(x_2,y )\frac{dx_2}{dy}-f(x_1,y)\frac{dx_1}{dy}+\frac{\partial}{\partial y}\int_{x_1(y)}^{x_2(y)}f(x,y)dx[/tex]
    And since [itex]\frac{\partial f}{\partial y}\int_{x_1(y)}^{x_2(y)}dx=\int_{x_1(y)}^{x_2(y)}\frac{\partial f}{\partial y}dx[/tex]
    We have our little theorem.

    So what are the requirements? First of all we used Clairaut's theorem so f should be continuous and [itex]f_y[/itex] should be continuous. Since continuity of [itex]G_x[/itex] doesn`t imply continuity of [itex]G_y[/itex].
    Ofcourse f is then integrable and so forth. I guess that's all we need.

    Thanks for your post too arildno, I`m gonna work that one out in detail as well.

    Now I can finally interchange the derivative and integral signs without the feeling that I`m doing something illegal! :biggrin:
  12. Jul 22, 2004 #11


    User Avatar
    Science Advisor
    Homework Helper
    Gold Member
    Dearly Missed

    Just to continue on my own track:

    where the limiting process is seen to yield:
  13. Jul 22, 2004 #12
    I'm pleased to....only that I'm not that good at analysis so you might find some serious mistakes in my post.

    I think one of the possible proofs is to use fubini's theorem. Now,

    [tex]\int_{a}^{b}\frac{\partial}{\partial y}\int_{c}^{d} f(x,y) dx dy [/tex]
    [tex] = \int_{c}^{d} f(x,b) dx - \int_{c}^{d} f(x,a) dx [/tex]
    [tex] = \int_{c}^{d}\int_{a}^{b} \frac{\partial}{\partial y} f(x,y) dy dx [/tex]
    [tex]= \int_{a}^{b}\int_{c}^{d} \frac{\partial}{\partial y}f(x,y) dx dy [/tex]

    where in the last step we have used fibini's theorem. Fibini's theorem applies because we assume that [tex]\frac{\partial}{\partial y}f(x,y) [/tex] is continuous and [a, b]x[c, d] is a compact set. Now since a, b are arbitrary, this can only mean,

    [tex]\frac{\partial}{\partial y}\int_{c}^{d} f(x,y) dx = \int_{c}^{d} \frac{\partial}{\partial y}f(x,y) dx [/tex]
    Last edited: Jul 23, 2004
  14. Jul 22, 2004 #13
    I took out a book (Advanced Calculus by Kaplan) this afternoon (couldn't wait) and found a proof both of Leibneiz's general rule for differentiating the integral and the rather mundane one. The mundane one says that

    [tex]\frac{d}{d y}\int_{c}^{d} f(x,y) dx = \int_{c}^{d} \frac{\partial}{\partial y}f(x,y) dx [/tex]

    provided of course that [tex]\frac{\partial f}{\partial y}[/tex] is continuous.
  15. Jul 23, 2004 #14


    User Avatar
    Science Advisor
    Homework Helper

    Homology, could you sketch the proof used in that book?
  16. Jul 23, 2004 #15
    I'll do a two part post, the following theorem is used in the proof of the larger and so I incorporate it here. It is verbatim (minus any tex errors I have introduced) from Kaplan's Book.

    Leibnitz's rule: Let [tex]f(x,t)[/tex] be continuous and have a continuous derivative [tex]f_t[/tex] in a domain of the x-t plane which includes the rectangle a < x < b and t1 < t < t2. Then for t1 < t < t2

    [tex]\frac{d}{d t}\int_{a}^{b}{f(x,t)}{dx} = \int_{a}^{b}\frac{\partial f(x,t)}{\partial t}{dx}[/tex]



    [tex]g(t)=\int_{a}^{b}\frac{\partial f}{\partial t}(x,t)dx\ (t_1 \leq t \leq t_2)[/tex]

    Since [tex]f_t[/tex] is continuous, one concludes from the theorem of Section 4-6 that g(t) is continuous for t1 < t < t2. (Note from Homology: this is just the standard analysis result, nothing special). Now for t1 < t3 < t2

    [tex]\int_{t_1}^{t_3}g(t)dt=\int_{t_1}^{t_3}\int_{a}^{b}\frac{\partial f}{\partial t}(x,t)dxdt;[/tex]

    by the theorem referred to one can interchange the order of integration:

    [tex]\int_{t_1}^{t_3}g(t)dt=\int_{a}^{b}\int_{t_1}^{t_3}\frac{\partial f}{\partial t}(x,t)dtdx=\int_{a}^{b}[f(x,t_3)-f(x,t_1)]dx[/tex]


    where[tex]F(t)[/tex] is defined by (4-91). (Note from Homology: 4-91 refers to [tex]\int_{a}^{b}f(x,t)dx=F(t)[/tex])

    If we now let t3 be simply a variable t, we have


    Both sides can now be differentiated with respect to t. By the fundamental theorem (4-19) (Note from Homology: he means the Fund. Th. of Calc.), one obtains

    [tex]\frac{d F}{d t} = g(t)=\int_{a}^{b}\frac{\partial f}{\partial t}(x,t)dx[/tex]

    Thus the rule is proved.
    Last edited: Jul 23, 2004
  17. Jul 23, 2004 #16
    Oh, yes, give me about 20 minutes for the full proof of the actual theorem, I'm pretty new to Latex and am awfully damn slow!

  18. Jul 23, 2004 #17
    Theorem Let f(x,t) satisfy the condition stated above for Leibnitz's rule. In addition, let a(t) and b(t) be defined and have continuous derivatives for t1 < t < t2. Then for t1 < t < t2

    [tex]\frac{d}{d t}\int_{a(t)}^{b(t)}f(x,t)dx=f[b(t),t]b'(t)-f[a(t),t]a'(t)+\int_{a(t)}^{b(t)}\frac{\partial f}{\partial t}(x,t)dx\\[/tex]

    The above equation is labelled (4-93)


    Let [tex]u=b(t),\ v=a(t),\ w=t[/tex], so that the integral F(t) can be written as follows:


    where u,v,w all depend on t. Hence by the chain rule:

    [tex]\frac{d F}{d t}=\frac{\partial G}{\partial u}\frac{d u}{dt}+\frac{\partial G}{\partial v}\frac{d v}{d t}+\frac{\partial G}{\partial w}\frac{d w}{d t}[/tex].

    It will be seen that the three terms here correspond to the three terms on the right of (4-93). Indeed one has

    [tex]\frac{\partial G}{\partial u}=\frac{\partial}{\partial u}\int_{v}^{u}f(x,w)dx=f(u,w),[/tex]

    by the fundamental theorem (4-19) (Note from Homology: see previous post). Since [tex] u=b(t), du/dt=b'(t)[/tex] and

    [tex]\frac{\partial G}{\partial u}\frac{d u}{d t}=f[b(t),t]b'(t)[/tex].

    The second term is accounted for similarly, the minus sign appearing because

    [tex]\frac{\partial}{\partial v}\int_{v}^{u}f(x,w)dx=\frac{\partial}{\partial v}\{-\int_{u}^{v}f(x,w)dx\}=-f(v,w).[/tex]


    [tex]\frac{\partial G}{\partial w}=\frac{\partial}{\partial w}\int_{v}^{u}f(x,w)dx=\int_{v}^{u}\frac{\partial f}{\partial w}(x,w)dx[/tex]

    By Leibnitz's rule. Since [tex]w=t, dw/dt=1[/tex] and the third term is accounted for.
  19. Jul 23, 2004 #18
    now for a little comment

    What I have gained from this little thread is one: the differentiating the integral trick and conditions for it to be valid, but also (2) that we have observed and learnt a method for dealing with integrals in this fashion, i.e. rename the integral as a function like G(v,u,w) or what not and then play with that, substituting the form of the function (the integral) in afterwards.

    Just an observation,

  20. Jul 23, 2004 #19


    User Avatar
    Science Advisor
    Homework Helper

    The theorems on interchange of limits, i.e. fubini (interchanging two integrals), and the rule on interchanging order of partials, and the rule on differentiating under the integral sign (interchanging a derivative and an integral), it seems i recall are all essentially equivalent. I.e. anyone implies the others.

    A nice treatment is in Spivak's Calculus on manifolds, and a more general treatment is in Lang's Analysis book (for lebesgue integrals).
  21. Jul 23, 2004 #20


    User Avatar
    Science Advisor
    Homework Helper

    Thanks Homology. Nice to see a proof which is sure to be valid, although it's the same as the other ones (except for arildno's).

    My derivation of Leibniz' rule uses Clairaut's theorem (equality of partial cross derivatives) instead of Fubini's theorem (exchanging the order of integration).
    I don`t know a proof of Fubini's theorem and my teacher said it will be handled
    later in a course on Measure theory.

    I`m sure Measure theory accounts for these rules in a far more general way (Fubini's theorem is more general than exchanging the order of integration), but as Mathwonk said, this special case of Fubini's theorem may be proved by Clairaut's theorem.
Share this great discussion with others via Reddit, Google+, Twitter, or Facebook