Proving variance with moment generating functions

Click For Summary

Discussion Overview

The discussion revolves around proving the variance of a random variable using moment generating functions (MGFs). Participants explore the mathematical derivation of the relationship between variance and the second derivative of the logarithm of the MGF, including the application of derivatives and the evaluation at specific points.

Discussion Character

  • Mathematical reasoning
  • Technical explanation
  • Homework-related

Main Points Raised

  • One participant presents the formula for variance in terms of the moment generating function, specifically Var(X) = \frac{d^2}{dt^2}ln M_X(t)\big |_{t=0} and expresses confusion about handling the logarithm of the integral.
  • Another participant suggests starting with the first derivative of the logarithm of a function, indicating a general approach to differentiation.
  • A subsequent reply outlines the process for finding the second derivative, providing a formula that involves the first and second derivatives of the function.
  • There is a suggestion that this method allows for expressing everything in terms of the generating function and its derivatives without logarithmic expressions.
  • A participant questions whether they need to substitute the MGF and its derivatives with their integral definitions and expresses concern about the complexity of the resulting expressions.
  • Another participant emphasizes the importance of evaluating at t=0, which leads to a moment of realization for the original poster regarding their earlier confusion.

Areas of Agreement / Disagreement

Participants generally agree on the mathematical approach to differentiating the logarithm of the moment generating function, but there is no consensus on the best method for simplifying the expressions involved or the necessity of substituting integral definitions.

Contextual Notes

Participants express uncertainty about the steps involved in simplifying the derivatives and the implications of substituting the integral definitions of the moment generating function.

TelusPig
Messages
15
Reaction score
0
Moment generating functions:
How can I show that Var(X)=\frac{d^2}{dt^2}ln M_X(t)\big |_{t=0}

Recall:
M_X(t)=E(e^{tx})=\int_{-\infty}^{\infty}e^{tx}f(x)dx

E(X^n)=\frac{d^n}{dt^n}M_X(t)\big |_{t=0}

Var(X)=E(X^2)-[E(X)]^2=E[(X-E(X))^2]
------------
I tried just applying the equation given but I don't know what to do with the log of this general integral?
\frac{d^2}{dt^2}ln M_X(t)=\frac{d^2}{dt^2}ln \left( \int_{-\infty}^{\infty}e^{tx}f(x)dx \right)
 
Physics news on Phys.org
If you were asked the more general question of calculating
\frac{d^2}{dt^2} \ln\left( f(t) \right)
What's the first thing you would do?
 
It would be for 1st derivative: \frac{1}{f(t)}*f'(t)
then differentiate again for the 2nd derivative, that would be:

\frac{f''(t)f(t)-(f'(t))^2}{(f(t))^2}
 
Last edited:
So once you do that you've expressed everything in terms of the generating function and its derivatives without any logarithms involved.
 
Does that mean it's \frac{M_X''(t)M_X(t)-(M_X'(t))^2}{(M_X(t))^2}

Do I have to then substitute each M(t), M'(t), M''(t) with it's integral definition then? and somehow simplify that big mess o.o?
 
No, you need to plug in t=0!
 
Office_Shredder said:
No, you need to plug in t=0!
OH obviously! LOL omg, I can't believe I didn't see that and thought I had to do a bunch of integrals ._. Thanks! :D
 

Similar threads

  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 9 ·
Replies
9
Views
3K
  • · Replies 42 ·
2
Replies
42
Views
6K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 1 ·
Replies
1
Views
3K
  • · Replies 0 ·
Replies
0
Views
2K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 5 ·
Replies
5
Views
3K
  • · Replies 25 ·
Replies
25
Views
3K
  • · Replies 1 ·
Replies
1
Views
2K