Mean and var of an exponential distribution using Fourier transforms

Click For Summary
SUMMARY

The discussion focuses on using Fourier transforms to calculate the mean and variance of the exponential distribution. The approach utilizes the Fourier transform properties, specifically the relationships FT[f(t)] and FT[t^n f(t)], to derive the expected values E[f] and E[f^2]. The calculations confirm that the mean is 1/λ and the variance is 1/λ², aligning with established results. The conversation also highlights the connection between characteristic functions, moment-generating functions, and Fourier transforms for deeper insights.

PREREQUISITES
  • Understanding of Fourier transforms and their properties
  • Familiarity with the exponential distribution and its probability density function
  • Knowledge of differentiation and integration techniques in calculus
  • Basic concepts of moment-generating functions and characteristic functions
NEXT STEPS
  • Explore the relationship between characteristic functions and moment-generating functions in probability theory
  • Study advanced applications of Fourier transforms in statistical mechanics
  • Investigate alternative methods for calculating moments of probability distributions
  • Learn about the implications of Fourier transforms in signal processing and data analysis
USEFUL FOR

Mathematicians, statisticians, and data scientists interested in probability theory, particularly those looking to enhance their understanding of Fourier transforms and their applications in calculating statistical moments.

Master1022
Messages
590
Reaction score
116
Homework Statement
Derive the mean and the variance of the exponential distribution using the Fourier transform
Relevant Equations
## FT[f(t)] = \int_{-\infty}^{\infty} f(t) e^{-j\omega t} dt ##
Hi,

I was just thinking about different ways to use the Fourier transform in other areas of mathematics. I am not sure whether this is the correct forum, but it is related to probability so I thought I ought to put it here.

Question: Is the following method an appropriate way to calculate the mean and variance of the exponential distribution? Have I overlooked any technicalities to get to the result?

I know that the standard proof isn't hard, but I was wondering whether there are faster ways (saves having to do the integration by parts)

Approach:
So we use the following principles for the Fourier transform:
## FT[f(t)] = \int_{-\infty}^{\infty} f(t) e^{-j\omega t} dt = F(\omega) ##
## FT[t^n f(t)] = j^n \frac{d^n F}{d\omega^n} ##

Using the second relation, we can see that:
$$ E[f(t)] = \int_{-\infty}^{\infty} t f(t) dt = \int_{-\infty}^{\infty} tf(t) e^{-j(0) t} dt = j \frac{d F}{d\omega} |_{\omega = 0} $$
and
$$ E[f^2] = \int_{-\infty}^{\infty} t^2 f(t) dt = \int_{-\infty}^{\infty} tf(t) e^{-j(0) t} dt = j^2 \frac{d^2 F}{d\omega^2} |_{\omega = 0} $$

We have ## f(t) = \lambda e^{-\lambda t} u(t) ## (0 for ## t < 0 ##) and we have the standard result that ## FT[e^{-at} u(t)] = \frac{1}{a+j\omega} ##. Therefore,
$$ FT[ \lambda e^{-\lambda t} u(t)] = \frac{\lambda}{\lambda+j\omega} $$
and
$$ E[f] = FT[ \lambda t e^{-\lambda t} u(t)] = j \frac{d }{d\omega} \left( \frac{\lambda}{\lambda+j\omega} \right)|_{\omega = 0} = \frac{\lambda}{(\lambda + j \omega)^2}|_{\omega = 0} = \frac{1}{\lambda} $$
Now we can do
$$ E[f^2] = FT[ \lambda t^2 e^{-\lambda t} u(t)] = j^2 \frac{d^2 }{d\omega^2} \left( \frac{\lambda}{\lambda+j\omega} \right)|_{\omega = 0} = \frac{2 \lambda}{(\lambda + j \omega)^3}|_{\omega = 0} = \frac{2}{\lambda^2} $$

Finally we can use: ## Var[f] = E[f^2] - (E[f])^2 = \frac{2}{\lambda^2} - \frac{1}{\lambda^2} = \frac{1}{\lambda^2} ##

which yields the expected result.

Have I overlooked any details along the way or is this a valid way to derive the required quantities?

Thanks.
 
Physics news on Phys.org
That looks good. You can take a look at how the characteristic function and the moment generating function of a probability distribution relate to each other and to it's Fourier transform for more insight.
 
  • Like
Likes   Reactions: Master1022
jambaugh said:
That looks good. You can take a look at how the characteristic function and the moment generating function of a probability distribution relate to each other and to it's Fourier transform for more insight.
Dear @jambaugh , thank you very much for responding! I will definitely look into those areas.

For anyone else looking at this forum, please note there is a slight typo in the post when I was copy and pasting the latex. The result is correct. The integral for the ## E[f^2] ## should read (I forgot the ## t^2 ## in the middle integral and instead left it as ## t ## when I copied the code from the ## E[f] ## integral):

$$ E[f^2] = \int_{-\infty}^{\infty} t^2 f(t) dt = \int_{-\infty}^{\infty} t^2 f(t) e^{-j(0) t} dt = j^2 \frac{d^2 F}{d\omega^2} |_{\omega = 0} $$
 

Similar threads

Replies
1
Views
2K
Replies
6
Views
3K
  • · Replies 2 ·
Replies
2
Views
4K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 6 ·
Replies
6
Views
1K
Replies
6
Views
2K
  • · Replies 17 ·
Replies
17
Views
10K
  • · Replies 3 ·
Replies
3
Views
3K
  • · Replies 1 ·
Replies
1
Views
1K
  • · Replies 6 ·
Replies
6
Views
4K