Derivative of integral of function with respect to the function


by DCG
Tags: derivative, function, integral, respect
DCG
DCG is offline
#1
Aug24-12, 05:15 PM
P: 6
Hi all,

I have the following quantity:

[itex]f = \int_{\mu}^{\infty} (1-F(x))a(x)dx[/itex]

I want to claim that by increasing the following quantity:

[itex]g = \int_{\mu}^{\infty} a(x)f(x)dx[/itex]

then [itex] f [/itex] can only increase. Can I differentiate [itex] f [/itex] with respect
to [itex] g [/itex]? Is the following correct?

[itex] \frac{\partial (\int_{\mu}^{\infty} (1-F(x))a(x)dx)}{\partial (\int_{\mu}^{\infty} a(x)f(x)dx)}[/itex]

[itex] = \frac{\frac{\partial (\int_{\mu}^{\infty} (1-F(x))a(x)dx)}{\partial x}}{\frac{\partial (\int_{\mu}^{\infty} a(x)f(x)dx)}{\partial x}}[/itex]

[itex] = \frac{(1-F(x))a(x)}{f(x)a(x)} [/itex]

[itex] = \frac{1-F(x)}{f(x)} [/itex]

I already know that [itex] a(x) > 0 [/itex] for [itex] x>\mu[/itex] and that [itex] \frac{1-F(x)}{f(x)} [/itex] is positive. Therefore [itex] f [/itex] increases when [itex] g [/itex] is increased. Does this resolve the problem?

Thank you for taking the time to read and answer!
Phys.Org News Partner Science news on Phys.org
Lemurs match scent of a friend to sound of her voice
Repeated self-healing now possible in composite materials
'Heartbleed' fix may slow Web performance
HallsofIvy
HallsofIvy is offline
#2
Aug24-12, 06:26 PM
Math
Emeritus
Sci Advisor
Thanks
PF Gold
P: 38,877
No, because you cannot differentiate f and g with respect to x- they are not functions of x.
DCG
DCG is offline
#3
Aug24-12, 08:46 PM
P: 6
Oh I see. Any pointers on how I could approach this though? Is there a name for this kind of problem? Anything I could read that could help me?

Thanks a lot!

Mute
Mute is offline
#4
Aug24-12, 10:40 PM
HW Helper
P: 1,391

Derivative of integral of function with respect to the function


It's not clear what you're trying to do. You have an expression for f that doesn't depend on g at all. Why are you talking about increasing g? Is F(x) given, or is the problem to determine F(x) in terms of g?
haruspex
haruspex is offline
#5
Aug25-12, 01:30 AM
Homework
Sci Advisor
HW Helper
Thanks ∞
P: 9,142
Quote Quote by DCG View Post
Hi all,

I have the following quantity:

[itex]f = \int_{\mu}^{\infty} (1-F(x))a(x)dx[/itex]

I want to claim that by increasing the following quantity:

[itex]g = \int_{\mu}^{\infty} a(x)f(x)dx[/itex]
In the second line, you have f as a function of one variable, x. But the first line doesn't make it a function of x. Rather, it appears to be a function of μ, and/or a functional of F(), a().
DCG
DCG is offline
#6
Aug25-12, 10:24 PM
P: 6
I am sorry, my choice of variable names is terrible. Let:

[itex]q = \int_{\mu}^{\infty} (1-F(x))a(x)dx[/itex]

In my first post I named it [itex]f[/itex] and it has nothing to do with [itex]f(x)[/itex].

[itex]g = \int_{\mu}^{\infty} a(x)f(x)dx[/itex]

Here [itex]F(x),f(x)[/itex] are fixed. They are the cdf and pdf of a regular distribution, [itex]\mu[/itex] is also fixed. It is the mean of that distribution. The only thing not fixed here is [itex]a(x)[/itex]. This function is positive for [itex]x>\mu[/itex] and is also monotone non-decreasing. My problem is the following:

Suppose I have some specific [itex]a(x)[/itex] and I want to replace it by another function ([itex]a_2[/itex]) with the same properties. Let:

[itex]q_2 = \int_{\mu}^{\infty} (1-F(x))a_2(x)dx[/itex]

and

[itex]g_2 = \int_{\mu}^{\infty} a_2(x)f(x)dx[/itex]

I want to prove that if [itex]g_2 \geq g[/itex] then [itex]q_2 \geq q[/itex]. Thanks your time.
DCG
DCG is offline
#7
Aug25-12, 11:35 PM
P: 6
So I read a bit about functional derivatives. It seems like [itex]q=q(a)[/itex] is a functional. It maps functions to numbers. So I can try and find its derivative with respect to [itex]a[/itex]. According to what I read:

[itex]\int \frac{\partial q(a)}{\partial a(x)}h(x)dx = {lim}_{\epsilon \rightarrow 0} \frac{q(a + \epsilon h) - q(a)}{\epsilon}[/itex]

[itex]= {lim}_{\epsilon \rightarrow 0} \frac{q(a) + \epsilon q(h) - q(a)}{\epsilon}[/itex] [itex]= q(h) = \int_{\mu}^{\infty}(1-F(x))h(x)[/itex]

Now if I assume that [itex]h(x)[/itex] is defined only on [itex][\mu ,\infty ][/itex] I have that:

[itex]\int_{\mu}^{\infty} \frac{\partial q(a)}{\partial a(x)}h(x)dx = \int_{\mu}^{\infty}(1-F(x))h(x)[/itex]

which means that (I am not sure about this):

[itex]\frac{\partial q(a)}{\partial a(x)} = (1-F(x))[/itex]

In the same way it turns out that [itex]\frac{\partial g(a)}{\partial a(x)} = f(x) [/itex]

Using the chain rule I get:

[itex]\frac{\partial q(a)}{\partial g(a)} = \frac{\frac{\partial q(a)}{\partial a(x)}}{\frac{\partial g(a)}{\partial a(x)}} = \frac{1-F(x)}{f(x)} \geq 0[/itex]

Does this even resemble anything valid?
Mute
Mute is offline
#8
Aug25-12, 11:46 PM
HW Helper
P: 1,391
That's more or less right, but you might run into problems trying to do it that way when your functionals aren't linear in your function a(x). When doing variational derivatives it's helpful to use the identity

$$\frac{\delta a(x)}{\delta a(y)} = \delta(x-y),$$
where ##\delta(x-y)## is the Dirac delta function (I will assume you know what this is, but ask if you don't). If we take the variational derivative of, say, g = g[a], we get

$$\frac{\delta g[a]}{\delta a(y)} = \int_{\mu}^\infty dx~f(x) \frac{\delta a(x)}{\delta a(y)} = \int_{\mu}^\infty dx~f(x) \delta(x-y) = f(y)\Theta(y-\mu),$$
where ##\Theta(x)## is the Heaviside step function, which appears because the delta function doesn't contribute anything to the integral unless y is in the integration range.

I'll let you try the variational derivative of q[a] for yourself.

What the derivative tells you is that if you have some fixed ##a(x)## and you perturb it to ##a(x) + \epsilon \delta a(x),## where ##\epsilon## is some small number and ##\delta a(x)## is O(1), then

$$g[a + \epsilon \delta a] \approx g[a] + \epsilon \int_{\mu}^\infty dy f(y) \delta a(y);$$
(well, it's exactly equal to that in this case because g was linearly dependent on a, but this is basically the functional equivalent of the tangent approximation to a function).

That said, I'll have to think for a second if the chain rule would work like that for variational derivatives.
chiro
chiro is offline
#9
Aug25-12, 11:51 PM
P: 4,570
Hey DCG and welcome to the forums.

You have a PDF so it means that the CDF is monotonic increasing. This implies 1 - F(x) is monotonic decreasing.

If g2 > g then this means integral of (a2(x) - a(x))f(x)dx over the appropriate interval is > 0. If q2 > q then this means integral (a2(x) - a(x))(1 - F(x))dx over the appropriate interval is also > 0.

But (a2(x) - a(x))(1 - F(x)) = (a2(x) - a(x)) - F(x)(a_2(x) - a(x)) which implies integral (a_2(x) - a(x))dx > F(x)(a_2(x) - a(x))dx over the right region (which makes sense).

Now we know (a_2(x) - a(x))dx > 0 and we know that F(x) <= 1 for any x by the properties of the CDF so the above inequality holds.
Mute
Mute is offline
#10
Aug26-12, 12:03 AM
HW Helper
P: 1,391
To push the functional way of doing it a little bit further (although DCG might be happy with chiro's solution, which is less technically demanding than what I'm about to do), I think the way you would need to think about things is like this: suppose g is just a variable, not a functional. Then we could interpret a(x) as a function of both x and g, which is determined by solving the integral equation

$$g = \int_{\mu}^\infty dx~f(x)a(x|g).$$

Differentiating implicitly with respect to g gives

$$1 = \int_{\mu}^\infty dx~f(x)\frac{\partial a(x|g)}{\partial g}.$$
Notice that if we set g = 1 in the first equation we would have a similar equation to this second one, suggesting that we can state

$$a(x|1) = \frac{\partial a(x|g)}{\partial g},$$
where a(x|1) is the solution to the original integral equation with g = 1.

Now, we can also consider q to be a function of g. (q is no longer considered to be a functional of a because a is determined by solving the integral equation). So,

$$q(g) = \int_{\mu}^\infty dx~(1-F(x))a(x|g),$$
and
$$\frac{\partial q(g)}{\partial g} = \int_{\mu}^\infty dx~(1-F(x))a(x|1).$$

One could then presumably solve the integral equation for a(x|1), and could then insert the solution into the equation for q'(g). Of course, the problem is that I don't think you get a unique solution. Suppose I set ##a(x|1) = h(x)/f(x)##, assuming f(x) is never zero on ##(\mu,\infty)##. Then all I need to do is pick any function h(x) that's normalizable on ##(\mu,\infty)##.
DCG
DCG is offline
#11
Aug26-12, 12:27 AM
P: 6
Quote Quote by chiro View Post
Hey DCG and welcome to the forums.

You have a PDF so it means that the CDF is monotonic increasing. This implies 1 - F(x) is monotonic decreasing.

If g2 > g then this means integral of (a2(x) - a(x))f(x)dx over the appropriate interval is > 0. If q2 > q then this means integral (a2(x) - a(x))(1 - F(x))dx over the appropriate interval is also > 0.

But (a2(x) - a(x))(1 - F(x)) = (a2(x) - a(x)) - F(x)(a_2(x) - a(x)) which implies integral (a_2(x) - a(x))dx > F(x)(a_2(x) - a(x))dx over the right region (which makes sense).

Now we know (a_2(x) - a(x))dx > 0 and we know that F(x) <= 1 for any x by the properties of the CDF so the above inequality holds.
Thank you for your answer but I do not understand what happened to f(x) in the integral of
(a2(x)-a1(x))f(x)dx >0
this does not imply that integral(a2(x)-a1(x))dx > 0
since f(x) could allocate more probability mass to intervals where a2(x)>a1(x) and less to opposite ones.
DCG
DCG is offline
#12
Aug26-12, 12:37 AM
P: 6
Quote Quote by Mute View Post
To push the functional way of doing it a little bit further (although DCG might be happy with chiro's solution, which is less technically demanding than what I'm about to do), I think the way you would need to think about things is like this: suppose g is just a variable, not a functional. Then we could interpret a(x) as a function of both x and g, which is determined by solving the integral equation

$$g = \int_{\mu}^\infty dx~f(x)a(x|g).$$

Differentiating implicitly with respect to g gives

$$1 = \int_{\mu}^\infty dx~f(x)\frac{\partial a(x|g)}{\partial g}.$$
Notice that if we set g = 1 in the first equation we would have a similar equation to this second one, suggesting that we can state

$$a(x|1) = \frac{\partial a(x|g)}{\partial g},$$
where a(x|1) is the solution to the original integral equation with g = 1.

Now, we can also consider q to be a function of g. (q is no longer considered to be a functional of a because a is determined by solving the integral equation). So,

$$q(g) = \int_{\mu}^\infty dx~(1-F(x))a(x|g),$$
and
$$\frac{\partial q(g)}{\partial g} = \int_{\mu}^\infty dx~(1-F(x))a(x|1).$$

One could then presumably solve the integral equation for a(x|1), and could then insert the solution into the equation for q'(g). Of course, the problem is that I don't think you get a unique solution. Suppose I set ##a(x|1) = h(x)/f(x)##, assuming f(x) is never zero on ##(\mu,\infty)##. Then all I need to do is pick any function h(x) that's normalizable on ##(\mu,\infty)##.
I like this approach. Since the only thing that I want to prove is that if g increases then
q can only increase or stay the same, it suffices to prove that:

[itex]\frac{\partial q(g)}{\partial g} \geq 0[/itex]

Thank you all for the answers.This was really helpful. I think that I am in the right direction now, so I will try to work it out.
chiro
chiro is offline
#13
Aug26-12, 03:19 AM
P: 4,570
Quote Quote by DCG View Post
Thank you for your answer but I do not understand what happened to f(x) in the integral of
(a2(x)-a1(x))f(x)dx >0
this does not imply that integral(a2(x)-a1(x))dx > 0
since f(x) could allocate more probability mass to intervals where a2(x)>a1(x) and less to opposite ones.
What does g2 - g >= 0 imply in terms of the integral?


Register to reply

Related Discussions
Integral equation with a derivative of the function inside the integral Calculus & Beyond Homework 5
Derivative of a integral function? General Math 3
Integral of type 'derivative over function' with a twist Calculus & Beyond Homework 2
Derivative with respect to a function Calculus 5
Differentiate an integration of a function with respect to that function itself Calculus 1