How to Find the MGF of the Highest Order Statistic of Exponential RVs?

  • Context: Graduate 
  • Thread starter Thread starter EngWiPy
  • Start date Start date
  • Tags Tags
    Statistics
Click For Summary

Discussion Overview

The discussion revolves around finding the moment generating function (MGF) of the highest order statistic from a set of independent and identically distributed exponential random variables. Participants explore the relationship between the MGF of the maximum order statistic and the MGFs of the exponential random variables, considering both specific calculations and potential generalizations.

Discussion Character

  • Technical explanation
  • Mathematical reasoning
  • Debate/contested

Main Points Raised

  • One participant seeks to find the MGF of the highest order statistic, \(\mathcal{M}_{\gamma^{(N)}}(s)\), and asks if it can be expressed in terms of the MGFs of the exponential random variables.
  • Another participant suggests that the MGF for the maximum order statistic can be derived from the properties of independent exponential random variables, hinting at a potential simplification due to their simple MGF form.
  • A participant shares their derived expression for the MGF of the maximum order statistic, indicating it may not be the most direct approach.
  • One participant confirms the correctness of the derived MGF and notes the similarity between the denominator of the derived expression and the MGF of the exponential distribution, suggesting a possible evaluation method to align them.
  • A later reply expresses a desire for a more general rule applicable to other distributions, such as Chi-square, and questions the feasibility of deriving a general form based on the matching of terms.

Areas of Agreement / Disagreement

Participants generally agree on the correctness of the derived MGF for the maximum order statistic but express uncertainty about the existence of a more direct method or a generalizable approach applicable to other distributions.

Contextual Notes

Participants discuss the specific properties of exponential distributions and their MGFs, but the conversation does not resolve whether a general form can be derived for other types of distributions.

EngWiPy
Messages
1,361
Reaction score
61
Hello,

Suppose we have the following set of independent and identically distributed exponential random variables: [tex]\gamma_1,\,\gamma_2,\ldots ,\,\gamma_N[/tex]. If we arrange them in ascending order we get the following order statistics: [tex]\gamma^{(1)}\leq\gamma^{(2)}\leq\cdots\leq\gamma^{(N)}[/tex].

I need to find the moment generating function (MGF) of the highest order statistics, i.e.: [tex]\mathcal{M}_{\gamma^{(N)}}(s)=E_{\gamma^{(N)}}[\text{e}^{s\,\gamma}][/tex] in terms of the MGFs of the exponential RVs. Is there any way to connect these MGFs?

Thanks in advance
 
Physics news on Phys.org
Have you already calculated the MGF for the maximum order statistic? This can be done just from knowing that you have identically distributed, independent exponential RVs. And since the MGF for an exponential RV is pretty simple, maybe there's some way to rewrite the MGF for the max order statistic in terms of them.
 
techmologist said:
Have you already calculated the MGF for the maximum order statistic? This can be done just from knowing that you have identically distributed, independent exponential RVs. And since the MGF for an exponential RV is pretty simple, maybe there's some way to rewrite the MGF for the max order statistic in terms of them.

Thanks for replying. I already derive the MGF of the maximum order statistic, which is as the following:

[tex]\mathcal{M}_{\gamma^{(N)}}(s)=\,N\,\sum_{k=0}^{N-1}\frac{(-1)^k\,{N-1\choose k}}{k+1-\overline{\gamma}\,s}[/tex]

but I thought there may be more direct way.

Regards
 
Yeah, that looks right. I am assuming that

[tex]\overline{\gamma} = \frac{1}{\lambda}[/tex] is the mean of the exponential distribution.

The MGF of the exponential distribution is

[tex]\phi(t) = \frac{1}{1-\overline{\gamma}t}[/tex]

The denominator of this looks pretty similar to the denominator of your expression. If you evaluate [tex]\phi(t)[/tex] for a value of t that depends on s, the mean, and k, you can make the denominators match.

I don't know if there's a more direct way. I'm thinking it is only because of the simple form of the exponential distribution that the MGF of the maximum order statistic can be written in terms of the MGF of the distribution of the [tex]\gamma_i[/tex].
 
techmologist said:
Yeah, that looks right. I am assuming that

[tex]\overline{\gamma} = \frac{1}{\lambda}[/tex] is the mean of the exponential distribution.

The MGF of the exponential distribution is

[tex]\phi(t) = \frac{1}{1-\overline{\gamma}t}[/tex]

The denominator of this looks pretty similar to the denominator of your expression. If you evaluate [tex]\phi(t)[/tex] for a value of t that depends on s, the mean, and k, you can make the denominators match.

I don't know if there's a more direct way. I'm thinking it is only because of the simple form of the exponential distribution that the MGF of the maximum order statistic can be written in terms of the MGF of the distribution of the [tex]\gamma_i[/tex].

You know, I began with the exponential distribution because it is simple, but in my work I am using very complicated distributions like the order statistics of Chi-square random variables. So, I need a general rule that can be used in all cases. Any way, we can derive this general form from matching as you said, but then the question is: is there any matching possible?

Regards
 

Similar threads

  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 35 ·
2
Replies
35
Views
5K
  • · Replies 2 ·
Replies
2
Views
3K
  • · Replies 8 ·
Replies
8
Views
3K
  • · Replies 9 ·
Replies
9
Views
4K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 1 ·
Replies
1
Views
4K
  • · Replies 5 ·
Replies
5
Views
2K
  • · Replies 56 ·
2
Replies
56
Views
11K
  • · Replies 100 ·
4
Replies
100
Views
13K