What does it mean if my result is off the known value by one Sigma?by content404 Tags: error analysis, standard deviation 

#1
Feb1413, 01:39 PM

P: 3

I'm putting together a lab report and my result is off from the known value by 1.43 σ. According to the error function tables provided by my prof, and using the error function in my error analysis textbook, that gives me a probability of ~85%.
I don't understand what this means though. Will a repeat experiment have an 85% chance of being within my standard of deviation or was there only a 15% chance that my result would be off by this much? The discrepancy between the known value and my experimental value is less than my total uncertainty so I think my result is reasonable. 



#2
Feb1413, 03:11 PM

Mentor
P: 10,853

If you repeat the experiment with perfect uncertainty analysis over and over again and have uncorrelated deviations, 85% of those experiments should be closer to the "true" value.
Note that this is an approximation for a gaussian error where the width does not change significantly if your measured value changes a bit. If that is not true, you need something like the FeldmanCousins method to get a similar number. 



#3
Feb1413, 03:25 PM

P: 3

Ok, I can see how that makes sense but I don't understand why it works like that.




#4
Feb1413, 03:55 PM

Mentor
P: 10,853

What does it mean if my result is off the known value by one Sigma?
Let's assume we know the exact value and all sources of error in the measurement (which can depend on that exact value), so we can predict how the measurements will be distributed. In addition, let's assume a gaussian distribution of those errors. If you get one measurement 1.43σ away from this exact value, you know that just 15% of all measurements will get a larger deviation (this is just a result of the gaussian distribution).
In a real experiment, you cannot use your knowledge of the exact value  you have to estimate the uncertainty based on your measurement. In many studies, this does not matter, and you can work like you had the situation described above: A gaussian distribution around the exact value, with the uncertainty of your measurement. 



#5
Feb1413, 04:09 PM

P: 313





#6
Feb1413, 06:53 PM

P: 3

Ok I get it now, thank you both.
If you're curious, I was conducting a repeat of the Franck Hertz experiment with 30 year old equipment. High precision, low accuracy. 



#7
Feb1513, 05:49 AM

P: 239

This really means that you cannot throw away your "known" value if you are interested in using it as the "true" value, at usual 1% or 5% levels. Because, even if the "known" is exactly the "true" value, then in the long run of your experiment you will get 15% values off by at least that much.



Register to reply 
Related Discussions  
Understanding Sigma and Sample Sizes  (high Sigma in small samples)  Set Theory, Logic, Probability, Statistics  9  
Dyna result doesn't match Test result  Mechanical Engineering  1  
Dyna result doesn't match Test result  Engineering Systems & Design  2  
Dyna result doesn't match Test result  Materials & Chemical Engineering  0  
Comparing f(sigma(x)) and sigma(f(x))  Calculus & Beyond Homework  3 