Explanation for moment-generating function

  • Context: Undergrad 
  • Thread starter Thread starter paotrader
  • Start date Start date
  • Tags Tags
    Explanation Function
Click For Summary
SUMMARY

The moment-generating function (MGF) is a crucial tool in mathematical statistics for determining the mean and variance of various distributions. It is defined as E[e^{tx}], where E[X^n] can be derived by taking the nth derivative of the MGF and evaluating it at zero. Specifically, the mean is calculated as M'_X(0) and the variance as M''(0) - M'(0)^2. Understanding the MGF allows for the calculation of moments about the origin, which is essential for statistical analysis.

PREREQUISITES
  • Understanding of calculus, particularly derivatives
  • Familiarity with basic probability concepts
  • Knowledge of statistical distributions, such as the Poisson distribution
  • Experience with mathematical expectations and integrals
NEXT STEPS
  • Study the derivation of the moment-generating function from its definition, E[e^{tx}]
  • Learn how to calculate the mean and variance using MGF for various distributions
  • Explore the differences in notation and definitions across resources like Wikipedia
  • Investigate the application of MGFs in advanced statistical methods and proofs
USEFUL FOR

Mathematical statisticians, students studying statistics, and anyone interested in understanding the properties of distributions through moment-generating functions.

paotrader
Messages
1
Reaction score
0
Hello everyone, I have taken up on reading a mathematical statistics book and have gotten stuck on the moment-generating function. I tried using Wikipedia for a simpler explanation to no avail...
I noticed it is used a lot in finding the mean & variance for all types of distributions. Can someone explain to me in layman's terms the moment generating function. I can't seem to connect the dots...

Thanks in advanced for any help...Paolo

P.S. I had calculus courses about 20 years ago...
 
Physics news on Phys.org
The nth moment about the origin is defined as

[tex]E[X^n]=\int_{-\infty}^{+\infty}x^nf(x)dx[/tex]

The mean is of course [itex]E[x]=\mu[/itex]. The variance is [itex]E[(X-E[X])^2][/itex] which can be shown to be equal to [itex]E[X^2]-E[X]^2[/itex].

The main point is that if you take the the nth derivative of the moment generating function and evaluate it at zero you get the nth moment about the origin. In symbols, [tex]E\left(X^n\right)=M_X^{(n)}(0)=\left.\frac{\mathrm{d}^n M_X(t)}{\mathrm{d}t^n}\right|_{t=0}[/tex]

The proof of the continuous case is given on the wikipedia page (the notation on wikipedia slightly differs, m_i is the ith moment about the origin, so [itex]m_i=E[X^i][/itex]). The moment generating function can be used to calculate the mean as [itex]M'_X(0)[/itex] and the variance as [itex]M''(0)-M'(0)^2[/itex]. You can look at the various wikipedia pages on particular distributions (like the poisson distribution) and calculate the means and variances from the moment generating function. If you're feeling adventurous you could calculate the moment generating function from the definition, [itex]E[e^{tx}][/itex].
 

Similar threads

  • · Replies 139 ·
5
Replies
139
Views
12K
  • · Replies 11 ·
Replies
11
Views
3K
  • · Replies 5 ·
Replies
5
Views
3K
  • · Replies 4 ·
Replies
4
Views
3K
  • · Replies 5 ·
Replies
5
Views
3K
  • · Replies 5 ·
Replies
5
Views
3K
  • · Replies 13 ·
Replies
13
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 5 ·
Replies
5
Views
2K
  • · Replies 5 ·
Replies
5
Views
2K