Why is noise always assumed to be Gaussian in noise-based applications?

  • Context: Undergrad 
  • Thread starter Thread starter csaspp
  • Start date Start date
  • Tags Tags
    Gaussian Noise
Click For Summary

Discussion Overview

The discussion centers on the assumption of Gaussian distribution in noise-based applications, exploring the reasons behind this common practice and the implications of the central limit theorem in relation to noise and measurement errors.

Discussion Character

  • Exploratory
  • Technical explanation
  • Debate/contested

Main Points Raised

  • One participant inquires about the rationale for assuming Gaussian distribution in noise-based applications.
  • Another participant explains that Gauss developed the Gaussian distribution for analyzing measurement errors, noting that under random deviations from true values, measurements tend to follow a Gaussian distribution.
  • Several participants reference the central limit theorem, stating that any sum or average of samples from any distribution will approximate a Gaussian distribution, especially with larger sample sizes.
  • There is a mention that for low numbers of observations, the Poisson distribution may be more appropriate than Gaussian.
  • One participant challenges the assumption of Gaussianity, suggesting that while data may appear normal, it is often difficult to determine if it is truly Gaussian or another distribution that is symmetric and unimodal.

Areas of Agreement / Disagreement

Participants express a mix of agreement regarding the central limit theorem's role in justifying the Gaussian assumption, but there is also disagreement about the prevalence of true Gaussian distributions in data, with some arguing that it is rare for data to be exactly Gaussian.

Contextual Notes

Participants note the limitations of assuming Gaussianity, including the potential for data to be contaminated or follow other distributions that may not fit the Gaussian model precisely.

csaspp
Messages
3
Reaction score
0
hi
i want to know why while dealing with any noise based application noise is assumed to be gaussian distributed?

give me the explanation clearly please
 
Physics news on Phys.org
Gauss developed the gaussian distribution to analyze measurement errors. He is often considered the greatest mathematician of all time, for many reasons, and in this case he was doing applied work in astronomy and realized he needed a general theory of error analysis. He proved that as long as the deviations from the true value are random, then the measurements will be in a gaussian distribution.

In other words noise is almost always normally distributed in all measurements under very general conditions, aside from unusual cases that involve a nonlinear bias in the measurement, or nonlinearity in the system itself (such phenomena are difficult to study for many reasons, and so the vast majority of applications deal with linear phenomena).
 
central limit theorem!
 
Yes, central limit theorem. By the central limit theorem, any sum or average of samples from ANY distribution (with finite mean and standard deviation) will be approximately Gaussian with the approximation better for larger samples. We can always consider "noise" or any measurement, as made up of many smaller parts so we can always assume an arbitrarily close approximation to Gaussian: i.e. Gaussian itself.
 
Unless the number of observations are low, in which case you can use the poisson distribution, correct?

Yeah, I always loved signal to noise ratio!
 
In modern music, how do you determine what is "signal" and what is "noise"?
 
"We can always consider "noise" or any measurement, as made up of many smaller parts so we can always assume an arbitrarily close approximation to Gaussian: i.e. Gaussian itself."

In relation to what?

It is actually rare for data to be exactly Gaussian (if I slip and say normal, I apologize for showing my American language preference). The center of data sets often seems to be normal, but typically we can't tell whether the data is Gaussian, close to it, is a contaminated normal, or is some other distribution that is symmetric and unimodal but longer-tailed than the Gaussian. This was (and is) the point made by Huber, Tukey, Hampel, and many others.
 

Similar threads

  • · Replies 0 ·
Replies
0
Views
2K
  • · Replies 2 ·
Replies
2
Views
1K
  • · Replies 6 ·
Replies
6
Views
3K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 3 ·
Replies
3
Views
3K
  • · Replies 4 ·
Replies
4
Views
2K
  • · Replies 19 ·
Replies
19
Views
3K
  • · Replies 10 ·
Replies
10
Views
3K
  • · Replies 5 ·
Replies
5
Views
3K
Replies
17
Views
6K