Differentiation Question

  • Thread starter EngWiPy
  • Start date
  • #1
1,367
61

Main Question or Discussion Point

Hi,

I have this derivation, and I am not sure how to derive it:

[tex]\frac{d}{dp(x)}\int_{-\infty}^{\infty}p(x)\,log(p(x))\,dx[/tex]

I mean, what to do with the integral?

Another thing, how to integrate:

[tex]\int_{-\infty}^{\infty}e^{x^2}\,dx[/tex]

Thanks in advance
 

Answers and Replies

  • #3
1,367
61
  • #4
757
0
Hi,

I have this derivation, and I am not sure how to derive it:

[tex]\frac{d}{dp(x)}\int_{-\infty}^{\infty}p(x)\,log(p(x))\,dx[/tex]

I mean, what to do with the integral?

Another thing, how to integrate:

[tex]\int_{-\infty}^{\infty}e^{x^2}\,dx[/tex]

Thanks in advance
Squaring something means multiplying it by itself:

I2 =
[tex](\int_{-\infty}^{\infty}e^{x^2}\,dx)(\int_{-\infty}^{\infty}e^{x^2}\,dx)[/tex]

x is a dummy variable of integration. You can change it to "y" (or your favorite letter)

[tex](\int_{-\infty}^{\infty}e^{x^2}\,dx)(\int_{-\infty}^{\infty}e^{y^2}\,dy)[/tex]

This is similar to a double integral where it got split up because the first integrand was independent of the other variable. You can put them back together (you should know what Fubini's theorem says).

Switch to polar coordinates and it becomes a simple integral over the entire r-theta plane.

Square root the answer at the end (since you just calculated the square of the answer, remember you squared the integral)

Eat cookie
 
  • #5
dextercioby
Science Advisor
Homework Helper
Insights Author
12,985
540
Hi,

I have this derivation, and I am not sure how to derive it:

[tex]\frac{d}{dp(x)}\int_{-\infty}^{\infty}p(x)\,log(p(x))\,dx[/tex]

I mean, what to do with the integral?
Good question. :) You perform it and end up with a number which, when differentiated wrt to a function gives 0, because it won't depend on x, or on p(x) anymore.

S_David said:
Another thing, how to integrate:

[tex]\int_{-\infty}^{\infty}e^{x^2}\,dx[/tex]

Thanks in advance
The function under the integral diverges when nearing the 2 infinities. The integral cannot be computed, because it's infinite.
 
  • #6
HallsofIvy
Science Advisor
Homework Helper
41,833
955
Good point bigubau! The others were thinking of
[tex]\int_{-\infty}^{\infty} e^{-x^2}dx[/tex]

S David, you seem to have difficulty distinguishing between a "definite" integral and "indefinite" integral. The first problem was also a "definite" integral and so, also as bitubau said, a constant. It's derivative is 0. The others were thinking of differentiating the "indefinite integral"
[tex]\frac{d}{dp(x)}\int p(x)\,log(p(x))\,dx[/tex]
 
  • #7
1,367
61
Good point bigubau! The others were thinking of
[tex]\int_{-\infty}^{\infty} e^{-x^2}dx[/tex]

S David, you seem to have difficulty distinguishing between a "definite" integral and "indefinite" integral. The first problem was also a "definite" integral and so, also as bitubau said, a constant. It's derivative is 0. The others were thinking of differentiating the "indefinite integral"
[tex]\frac{d}{dp(x)}\int p(x)\,log(p(x))\,dx[/tex]
Thank you all for these comments. Actually HallsofIvy, the integral in hand came from an optimization problem, and if it is 0, then we can not find the optimum solution. The problem is:

[tex]\underset{p(x)}{\text{max}}-\int_{-\infty}^{\infty}p(x)\log_2[p(x)]\,dx[/tex]

subject to:

[tex]\int_{-\infty}^{\infty}p(x)\,dx=1[/tex]
 
  • #8
Mute
Homework Helper
1,388
10
Hi,

I have this derivation, and I am not sure how to derive it:

[tex]\frac{d}{dp(x)}\int_{-\infty}^{\infty}p(x)\,log(p(x))\,dx[/tex]
It looks like what you actually want to be doing here is taking a functional derivative.

That is, I think what you want is

[tex]\frac{\delta}{\delta p(y)}\int_{-\infty}^{\infty}p(x)\,log(p(x))\,dx[/tex]

The usual rules of regular calculus usually apply, but note

[tex]\frac{\delta f(x)}{\delta f(y)} = \delta(x-y)[/tex]
where [itex]\delta(x-y)[/itex] is the dirac delta. In doing this you will not get zero as an answer.
 

Related Threads on Differentiation Question

  • Last Post
Replies
11
Views
2K
  • Last Post
Replies
2
Views
1K
  • Last Post
Replies
4
Views
10K
Replies
4
Views
2K
Replies
3
Views
641
Replies
1
Views
869
Replies
5
Views
2K
Replies
2
Views
837
Top