Derivation of Vasicek Entropy Estimator

  • Thread starter Thread starter thrillhouse86
  • Start date Start date
  • Tags Tags
    Derivation Entropy
thrillhouse86
Messages
77
Reaction score
0
Hey All - I am trying to solve a problem that should be really easy (at least every paper I read says the step is!)

I'm trying to understand where the Vasicek entropy estimator comes from:

I can write the differential entropy of a system as:
<br /> H(f) = -\int^{\infty}_{-\infty} f(x)log(f(x))dx<br />

where f(x) is your probability distribution function

Apparently it is an easy step that you can re-write this in the form:
<br /> H(f) = \int^{1}_{0} log(\frac{d}{dp}F^{-1}(p)) dp<br />

Where F^{1} is the inverse of the culmative distribution function.

I've tried using the derivative of an inverse function that I learned when trying to find the derivative of inverse trig functions but all I got was:

<br /> \frac{d F^{-1}(p)}{dp} = \frac{1}{f(F^{-1}(p))}<br />

By the way just in case I need to point it out - this isn't homework - its a stupid problem which is making me feel incredibly stupid not being able to solve

Thanks,
Thrillhouse
 
Last edited:
Physics news on Phys.org
Maybe it's "integration by sustitution" with x = F^{-1}(p)
 
Namaste & G'day Postulate: A strongly-knit team wins on average over a less knit one Fundamentals: - Two teams face off with 4 players each - A polo team consists of players that each have assigned to them a measure of their ability (called a "Handicap" - 10 is highest, -2 lowest) I attempted to measure close-knitness of a team in terms of standard deviation (SD) of handicaps of the players. Failure: It turns out that, more often than, a team with a higher SD wins. In my language, that...
Hi all, I've been a roulette player for more than 10 years (although I took time off here and there) and it's only now that I'm trying to understand the physics of the game. Basically my strategy in roulette is to divide the wheel roughly into two halves (let's call them A and B). My theory is that in roulette there will invariably be variance. In other words, if A comes up 5 times in a row, B will be due to come up soon. However I have been proven wrong many times, and I have seen some...
Back
Top