Can a Gaussian distribution be represented as a sum of Dirac Deltas?

Click For Summary
SUMMARY

The discussion confirms that a Gaussian distribution can be represented as a limiting case of Dirac Delta functions when the width of the Gaussian, denoted as ##\sigma##, approaches zero. The equation $$\delta(x - \mu) = lim_{\sigma -> 0} \frac{1}{\sqrt{2\pi \sigma^2}} e^{\frac{-(x - \mu)^2}{2\sigma^2}}$$ illustrates this relationship. Furthermore, it is established that a Gaussian spectrum can be approximated as a weighted sum of Dirac Deltas, expressed as $$\frac{1}{\sqrt{2\pi \sigma^2}} e^{\frac{-(x - \mu)^2}{2\sigma^2}} = \sum_{i} w_i \delta(x - i)$$, where the weights ##w_i## determine the distribution. The discussion also highlights that while any function can be represented as an integral of Dirac Deltas, a discrete sum approximation is feasible under certain conditions.

PREREQUISITES
  • Understanding of Gaussian distributions and their properties
  • Familiarity with Dirac Delta functions and their mathematical implications
  • Knowledge of limits and integrals in calculus
  • Basic concepts of numerical approximations in mathematical functions
NEXT STEPS
  • Explore the mathematical properties of Dirac Delta functions in detail
  • Study the implications of Gaussian distributions in signal processing
  • Learn about numerical methods for approximating functions using delta functions
  • Investigate the applications of weighted sums in statistical modeling
USEFUL FOR

Mathematicians, physicists, engineers, and data scientists interested in advanced mathematical modeling, signal processing, and the theoretical foundations of distributions.

tworitdash
Messages
104
Reaction score
25
We know that Dirac Delta is not a function. However, I just talk about the numerical version of it that we use every day. We can simply represent the Dirac delta function as a limiting case of Gaussian distribution when the width of the distribution ##\sigma->0##.

$$
\delta(x - \mu) = lim_{\sigma -> 0} \frac{1}{\sqrt{2\pi \sigma^2}} e^{\frac{-(x - \mu)^2}{2\sigma^2}}
$$

Is it possible to also say the reverse with a weighted sum of Dirac Deltas to construct a Gaussian spectrum?

$$
\frac{1}{\sqrt{2\pi \sigma^2}} e^{\frac{-(x - mu)^2}{2\sigma^2}} = \sum_{i} w_i \delta(x - i)
$$

Where, somehow the weights ##w_i## constitute how it is distributed (##\sigma##). If yes, how do we decide these weights?
 
Physics news on Phys.org
Any function can be represented as a sum of Dirac delta functions:

Let ##f(x)## be an arbitrary function of ##x##. Then you can represent it as:

##\int f(y) \delta(x-y) dy##

So that's a weighted sum (well, integral) of delta functions.
 
  • Like
Likes   Reactions: BvU
stevendaryl said:
Any function can be represented as a sum of Dirac delta functions:

Let ##f(x)## be an arbitrary function of ##x##. Then you can represent it as:

##\int f(y) \delta(x-y) dy##

So that's a weighted sum (well, integral) of delta functions.

If you really want a discrete sum, instead of an integral, then it can't be done for most functions. But I guess for some purposes, you can approximate a function by delta functions: Pick a small positive x increment ##\Delta x## and define ##\tilde{f}(x, \Delta x)## by:

##\tilde{f}(x, \Delta x) = \sum_j f(j \Delta x) \delta(x- j\Delta x) \Delta x##

where ##\Delta x## is some small real number. This approximation works in an integration sense: For any other smooth function ##g(x)##, we have:

##lim_{\Delta x \Rightarrow 0} \int \tilde{f}(x, \Delta x) g(x) dx = \int f(x) g(x) dx##
 
  • Like
Likes   Reactions: tworitdash

Similar threads

  • · Replies 12 ·
Replies
12
Views
5K
  • · Replies 11 ·
Replies
11
Views
2K
  • · Replies 12 ·
Replies
12
Views
2K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 8 ·
Replies
8
Views
2K
Replies
1
Views
4K
Replies
5
Views
5K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 4 ·
Replies
4
Views
2K
  • · Replies 16 ·
Replies
16
Views
2K