Poisson Error Q: Can I Add Errors in Quadrature?

  • Context: Undergrad 
  • Thread starter Thread starter Malamala
  • Start date Start date
  • Tags Tags
    Error Poisson
Click For Summary

Discussion Overview

The discussion revolves around the propagation of errors in the context of predicting counts from a fitted function to a histogram, specifically addressing the addition of errors in quadrature and the treatment of systematic versus statistical errors.

Discussion Character

  • Technical explanation
  • Debate/contested
  • Mathematical reasoning

Main Points Raised

  • One participant proposes that when predicting counts using a fitted function, one can consider both the error from the fit and the Poisson error in quadrature, resulting in a combined uncertainty.
  • Another participant argues that for certain values, the error in the fitted parameters can be ignored, suggesting that the error estimate should match the precision of the predicted value.
  • A different viewpoint suggests that when reporting results, systematic errors should be kept separate from statistical errors, especially when dealing with a series of predictions.
  • One participant questions whether to use the combined error for assessing the significance of a bump in the data, indicating uncertainty about whether to include the fit error in the calculation of significance.
  • Another participant emphasizes that the prediction should reflect uncertainties from the fit only, while the actual results will have additional spread due to the Poisson distribution, which is not typically considered an uncertainty of the prediction.
  • A further contribution clarifies that the predicted counts from the fitted function do not necessarily need to be integers, as they represent the mean of a Poisson distribution.

Areas of Agreement / Disagreement

Participants express differing views on whether to combine errors in quadrature and how to treat systematic versus statistical errors. There is no consensus on the best approach to error propagation in this context.

Contextual Notes

Some participants highlight the importance of considering the precision of reported values and the nature of the errors involved, indicating that assumptions about the fit accuracy and the nature of the data can influence the discussion.

Who May Find This Useful

This discussion may be of interest to those involved in data analysis, particularly in fields requiring statistical modeling and error propagation, such as experimental physics or data science.

Malamala
Messages
348
Reaction score
28
Hello! I have a fit to a histogram ##y(x)##. Now I want to predict the number of counts at some other point, not in the original data, using this fitted function and assign an error to it. Let's say that the the point where I want to compute this value, ##x_0## gives ##y(x_0) = 100##. As the function ##y(x)## was obtained from a fit, it has some error associated to the error propagation of the errors on the parameters of ##y##. Let's assume that that error is 2. Now, as this functions measure counts, the error associated to it can be considered a Poisson error i.e. assuming that I wouldn't have that error of 2, I would give my result as ##100 \pm \sqrt{10} = 100 \pm 10##. Now given that I have that 2, can I just add the two sources of error in quadrature and give my result as ##100 \pm \sqrt{4+100} = 100 \pm 10.2##? Is this correct?
 
Physics news on Phys.org
Hi,

With numbers like that you can ignore the error in the fitted parameters: you shouldn't quote 100 ##\pm## 10.2 because your estimate has no decimals ##\rightarrow## your error estimate doesn't either.

If the fit is a lot less accurate, say with an error of 10, then yes, I would add in quadrature if I only had to report ##y(x_0)##.
If I had to erport a series of ##y(x_i)##, I would keep the fit error separated (it's a systematic error).
 
BvU said:
Hi,

With numbers like that you can ignore the error in the fitted parameters: you shouldn't quote 100 ##\pm## 10.2 because your estimate has no decimals ##\rightarrow## your error estimate doesn't either.

If the fit is a lot less accurate, say with an error of 10, then yes, I would add in quadrature if I only had to report ##y(x_0)##.
If I had to erport a series of ##y(x_i)##, I would keep the fit error separated (it's a systematic error).
Thank you! So ideally I should quote my result (for a fit error of 10) as ##100 \pm (10)_{stat} \pm (10)_{sys}##. Is this right? One more question about my initial example. Assuming that using the parameters obtained by that fit i.e. ##y(x)##, I try to fit to some other data and I see a bump in a given bin, and I want to see how statistically significant it is. So in order to do that I would calculate ##|y_{bump} - y(x_{bump})|/\sigma_y##. Should I use in this case ##10.2## as the value for ##\sigma_y##? Or can I still safely use just 10?
 
Ah, the ice gets thinner !

With your fit you calculate ##y(x_\text{bump}) = 100\pm 10_\text{sys}## but your measurement give you ##y_\text{bump}\pm\sqrt{y_\text{bump}}## and therefore the net height of the bump has error ##\sqrt{100 + y_\text{bump}}## .

In other words: I would ignore the statistical error in ##y(x_0)## ... (*)

This goes to show you really want a low background, and if that's done, you also want a very good fit of that background !(*) don't feel 100 (##\pm##10 % :smile: ) certain here, could use some help from e.g. @mfb
 
Your prediction will be the fit result with uncertainties from the fit only. The actual results will have some spread from their Poisson distribution, but typically this is not considered an uncertainty of your prediction, it is an uncertainty from the experimental realization testing this prediction. Take 10 times as much data and your relative uncertainty will be lower.
 
  • Like
Likes   Reactions: Klystron and BvU
Malamala said:
Hello! I have a fit to a histogram ##y(x)##. Now I want to predict the number of counts at some other point, not in the original data, using this fitted function and assign an error to it.

Is the prediction ##y(x)##actually an integer number of counts at the value ##x## (whatever ##x## represents)? If the prediction predicts the parameter ##\lambda## of Poission distribution, it can be used to predict the mean number of counts at the value ##x##. This mean number of counts need not be an integer.
 

Similar threads

  • · Replies 4 ·
Replies
4
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 17 ·
Replies
17
Views
2K
Replies
28
Views
4K
  • · Replies 16 ·
Replies
16
Views
2K
  • · Replies 5 ·
Replies
5
Views
2K
  • · Replies 37 ·
2
Replies
37
Views
5K
  • · Replies 5 ·
Replies
5
Views
2K
  • · Replies 31 ·
2
Replies
31
Views
3K