Distribution of the sample mean of an exponential distribution

Click For Summary
SUMMARY

The distribution of the sample mean (Ybar) for a random sample of 5 values drawn from an exponential distribution with a mean of 8 is described by the Erlang distribution, a specific case of the Gamma distribution. The variance of the sample mean is not equal to the variance of the individual exponential distributions, which is 64. Instead, the probability density function (pdf) for the sample mean is given by f'(x; 5, r) = (625/24) * e^(-5*x*r) * r^5 * x^4, where r = 1/mean. This approach involves convolution and transformation of random variables.

PREREQUISITES
  • Understanding of exponential distributions and their properties
  • Familiarity with the Erlang distribution and Gamma distribution
  • Knowledge of probability density functions (pdf)
  • Basic concepts of convolution in probability theory
NEXT STEPS
  • Study the properties of the Erlang distribution in detail
  • Learn about convolution methods for independent random variables
  • Explore the derivation of the Gamma distribution and its applications
  • Investigate the distribution of the sample variance for iid exponential distributions
USEFUL FOR

Statisticians, data scientists, and anyone involved in probability theory or statistical analysis, particularly those working with exponential distributions and their sample statistics.

buggy418
Messages
2
Reaction score
0
Let's say you have a random sample of 5 values that are drawn from an exponential distribution with a mean of 8.

How do I find the distribution of Ybar, which is the sample mean of the 5 random variables? [Note: Ybar = 1/5(Y₁+Y₂+Y₃+Y₄+Y₅)]

I know that for an exponential distribution with mean 8 (i.e. Y~exp(8)), the variance would be 64.
So it seems like the distribution of Ybar can't also be exponential, since the variance is supposed to be the mean squared. I figure the mean of Ybar will be 8, but the variance must be something other than 64.
I don't know what approach to take...this seems harder than the approach for a normal distribution.
 
Physics news on Phys.org
You need to compute the five fold convolution of the exponential distribution. Have you studied convolutions?
 
buggy418 said:
How do I find the distribution of Ybar, which is the sample mean of the 5 random variables? [Note: Ybar = 1/5(Y₁+Y₂+Y₃+Y₄+Y₅)]


So it seems like the distribution of Ybar can't also be exponential

True. What distribution would you expect for the sample means?
 
I think it may have a gamma distribution of some sort. We've learned the method of distribution functions. So maybe if I let V=5Y, and then found the distribution of V/5 that would work? But it seems like that's just going to make me end up at the exponential distribution again, since V/5 = 5Y/5 = Y.
 
buggy418 said:
So maybe if I let V=5Y

No, that would imply you had 5 copies of the same outcome, not 5 independent outcomes. You're going to have to do a convolution or look up the answer in a reference. Generating functions might help with a convolution.
 
Sorry to dig up a two-month old thread, but in the course of solving a different problem, I may have found a straight-forward answer to the problem presented by the OP. Here it is, for future reference.

The OP was on the right lines with the Gamma distribution. In particular, it is the Erlang distribution, which is a special case of the Gamma distribution, that is appropriate in this case.

Recall that the distribution of the sum of k iid exponential distributions is described by the Erlang distribution. That is,
Erl(k,r) ~ Exp(r) + … + Exp(r). (Sum of k exponential distros.)
Here we use r to denote the rate parameter (more commonly denoted by lamda), where r = 1/mean.

The pdf of the Erlang distro is given by
f( x; k, r ) = ( r^k * x^(k-1) * e^(-r*x) ) / (k-1)! .
(Wiki page for more info on the Erlang distro: http://en.wikipedia.org/wiki/Erlang_distribution )

So, to find the distribution of the sample mean of k values drawn from k iid exponential distributions we simply need to find
1/k * Erl(k,r).
This is a scalar multiple of a random variable. The transformation of the random variable yields a distribution with pdf
f'( x; k, r ) = f( x*k; k, r ) = ( r^k * (x*k)^(k-1) * e^(-r*x*k) ) / (k-1)!.

In the OP's case we have k=5; plugging this into the pdf gives
f'( x; 5, r ) = (625/24) * e^(-5*x*r) * r^5 * x^4.

This is my first post here. I may have made a mistake. A quick numerical test gives similar results. Also the convolution method for k=2 gives the same result.

In case anyone's interested, my own problem is to find the distribution of the sample *variance* of k iid exponential distributions. I have yet to find the solution.
 
mattjw said:
Sorry to dig up a two-month old thread, but in the course of solving a different problem, I may have found a straight-forward answer to the problem presented by the OP. Here it is, for future reference.

The OP was on the right lines with the Gamma distribution. In particular, it is the Erlang distribution, which is a special case of the Gamma distribution, that is appropriate in this case.

Recall that the distribution of the sum of k iid exponential distributions is described by the Erlang distribution. That is,
Erl(k,r) ~ Exp(r) + … + Exp(r). (Sum of k exponential distros.)
Here we use r to denote the rate parameter (more commonly denoted by lamda), where r = 1/mean.

The pdf of the Erlang distro is given by
f( x; k, r ) = ( r^k * x^(k-1) * e^(-r*x) ) / (k-1)! .
(Wiki page for more info on the Erlang distro: http://en.wikipedia.org/wiki/Erlang_distribution )

So, to find the distribution of the sample mean of k values drawn from k iid exponential distributions we simply need to find
1/k * Erl(k,r).
This is a scalar multiple of a random variable. The transformation of the random variable yields a distribution with pdf
f'( x; k, r ) = f( x*k; k, r ) = ( r^k * (x*k)^(k-1) * e^(-r*x*k) ) / (k-1)!.

In the OP's case we have k=5; plugging this into the pdf gives
f'( x; 5, r ) = (625/24) * e^(-5*x*r) * r^5 * x^4.

This is my first post here. I may have made a mistake. A quick numerical test gives similar results. Also the convolution method for k=2 gives the same result.

In case anyone's interested, my own problem is to find the distribution of the sample *variance* of k iid exponential distributions. I have yet to find the solution.

A factor of k seems to be missing from your f', but anyway if you just need to find the sample variance for sample size k, it's just (1/k) times the variance of the exponential distribution.
 

Similar threads

  • · Replies 6 ·
Replies
6
Views
3K
  • · Replies 31 ·
2
Replies
31
Views
3K
  • · Replies 4 ·
Replies
4
Views
2K
  • · Replies 7 ·
Replies
7
Views
3K
  • · Replies 5 ·
Replies
5
Views
2K
Replies
5
Views
5K
  • · Replies 9 ·
Replies
9
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 13 ·
Replies
13
Views
3K
  • · Replies 1 ·
Replies
1
Views
2K