Fit a Poisson on Gaussian distributed data
- Context: Undergrad
- Thread starter ChrisVer
- Start date
-
- Tags
- Data Distributed Fit Gaussian Poisson
Join the discussion
Registration is free. Ask a follow-up in this thread, or start your own.
10 replies · 2K views
Discussion
Physics news on Phys.org
Science Advisor
Homework Helper
Education Advisor
- 7,864
- 1,605
For the question to be interpreted in any specific way, you need to describe the data (precisely).
Homework Helper
- 4,817
- 134
Hey ChrisVer.
Poisson distributions (and Poisson processes) are constructed from very specific first principles where they represent rates as a limit to a Binomial distribution (with certain properties).
Usually these processes model rates and similar phenomena - you might want to tell us what you are trying to do so we can give further feedback.
Poisson distributions (and Poisson processes) are constructed from very specific first principles where they represent rates as a limit to a Binomial distribution (with certain properties).
Usually these processes model rates and similar phenomena - you might want to tell us what you are trying to do so we can give further feedback.
Science Advisor
Homework Helper
- 9,564
- 4,799
If you have reason to think that the process is a Poisson process, you may want to check the sample variance. Poisson only has one parameter, λ, which is both the mean and variance. If the sample mean and variance are close, you can probably model it as Poisson. Otherwise, Gaussian would probably give a better fit.
You might also want to check the sample skewness. It should be close to λ-1/2.
PS. I am not sure how to define "close to" for the sample variance and skew. Maybe you can Google a confidence interval.
You might also want to check the sample skewness. It should be close to λ-1/2.
PS. I am not sure how to define "close to" for the sample variance and skew. Maybe you can Google a confidence interval.
- 22,170
- 3,335
ChrisVer said:the problem with the gauss is that it's symmetric around the mean something that was not the case for my histograms.
I thought about fitting on it, to get the Var, but at the end I chose to integrate it and find the +/- 34%
Have you tried to transform your histograms? like take the logarithm of the data often makes things more symmetric.
- 22,170
- 3,335
ChrisVer said:That's an example of a histo...
Try a Box-Cox transformation to make it more normal.
Homework Helper
- 4,817
- 134
You should probably tell us what you are trying to do before using arbitrary transformations, test statistics and inferences.
Transforming data out of context is not a good idea and depending on what resolutions you are trying to make it can actually be detrimental to getting a useful inference.
Transforming data out of context is not a good idea and depending on what resolutions you are trying to make it can actually be detrimental to getting a useful inference.
Science Advisor
- 3,372
- 465
What I wanted to do was to:
not add bins in order to find the +/- 34.1% errors to the red line, which can be binning dependent.
but instead fit a function on the distribution, and integrate that function around the red line to get the +/-34.1%.
Obviously the distribution is not Gaussian, but looks more like a Poisson...
I was thinking about rescaling the x-axis [since Poisson is accepting integer entries while I have floats], doing the fit, integrating, and then scale everything [together with the obtained variances] back to the original x-axis.
The point is that I have other distributions which look pretty much like Gaussians, and I wanted to make sure I could use a Poisson to fit them too [since the code should do that, I wouldn't want to check everytime the distribution and determine with what I could fit it with].
not add bins in order to find the +/- 34.1% errors to the red line, which can be binning dependent.
but instead fit a function on the distribution, and integrate that function around the red line to get the +/-34.1%.
Obviously the distribution is not Gaussian, but looks more like a Poisson...
I was thinking about rescaling the x-axis [since Poisson is accepting integer entries while I have floats], doing the fit, integrating, and then scale everything [together with the obtained variances] back to the original x-axis.
The point is that I have other distributions which look pretty much like Gaussians, and I wanted to make sure I could use a Poisson to fit them too [since the code should do that, I wouldn't want to check everytime the distribution and determine with what I could fit it with].
Homework Helper
- 4,817
- 134
If you want to fit probabilities to data then that is understandable - but I ask because if it based on a particular process (of which the distribution constraints should be derived) then it means you typically construct models for specific reasons before you fit them.
I'd look at Gamma, Chi-square and other generalized distributions of these for more. You'll find they can deal with these bumps and skewness and you can estimate the parameters of these distributions and do goodness of fit tests.
I'd look at Gamma, Chi-square and other generalized distributions of these for more. You'll find they can deal with these bumps and skewness and you can estimate the parameters of these distributions and do goodness of fit tests.
Similar threads
High School Sigma Multiplied Gaussian Distribution
- jaydnul
- · Replies 2 ·
- Set Theory, Logic, Probability, Statistics
- Replies
- 2
Undergrad Can a Gaussian distribution be represented as a sum of Dirac Deltas?
- tworitdash
- · Replies 2 ·
- Set Theory, Logic, Probability, Statistics
- Replies
- 2
Undergrad How Should You Approach Fitting Multiple Gaussians to Data with Poisson Errors?
- Malamala
- · Replies 28 ·
- Set Theory, Logic, Probability, Statistics
- Replies
- 28
Undergrad How to convert a gaussian distributed rnd sequence to uniform dist and viceversa
- dexterdev
- · Replies 1 ·
- Set Theory, Logic, Probability, Statistics
- Replies
- 1
Graduate Gaussian distributed falling drops on a non-orthogonal plane
- condorino
- · Replies 10 ·
- Set Theory, Logic, Probability, Statistics
- Replies
- 10
Graduate Mutual Information between two Gaussian distributions
- six7th
- · Replies 7 ·
- Set Theory, Logic, Probability, Statistics
- Replies
- 7
Undergrad Intuitive explanations for Gaussian distribution function and mahalanobis distance
- jjepsuomi
- · Replies 8 ·
- Set Theory, Logic, Probability, Statistics
- Replies
- 8
Graduate Model parameter distributions from Gamma distributed data
- mikeclimber1
- · Replies 6 ·
- Set Theory, Logic, Probability, Statistics
- Replies
- 6
Graduate Statistical Error of Centroid of Gaussian Distribution
- weetabixharry
- · Replies 1 ·
- Set Theory, Logic, Probability, Statistics
- Replies
- 1
Graduate Continous Time Gaussian Distribution
- EngWiPy
- · Replies 7 ·
- Set Theory, Logic, Probability, Statistics
- Replies
- 7