About comparison to experimental reference values

Click For Summary

Discussion Overview

The discussion revolves around the comparison of experimental measurements of physical constants with reference values, focusing on the statistical methods used to assess the agreement between these values. It touches on the challenges posed by uncertainty in measurements and the implications for hypothesis testing.

Discussion Character

  • Technical explanation
  • Mathematical reasoning
  • Debate/contested

Main Points Raised

  • One participant questions how to prove hypotheses regarding physical constants that have inherent uncertainties, suggesting the use of statistical methods for comparison.
  • Another participant agrees on the use of statistical methods and emphasizes that reference values should be treated like any other measurement, proposing that the difference between measurements should be analyzed with error propagation.
  • A later reply raises a question about the degrees of freedom in the context of using the t-student test for comparison, specifically whether it should be n or n-1.
  • Another participant provides a formula for calculating degrees of freedom, indicating that it is typically n minus the number of restrictions.
  • Further clarification is provided that in this context, one restriction is commonly used.
  • Areas of Agreement / Disagreement

    Participants generally agree on the use of statistical methods for comparing measurements, but there is a lack of consensus on the specifics of calculating degrees of freedom in this context.

    Contextual Notes

    There are unresolved aspects regarding the assumptions made about the data and the specific statistical methods applicable to different types of measurements.

chastiell
Messages
11
Reaction score
0
Hi again, probably this seems to be a simply question, but in last days i becomes a really strange one.

We all know that there are many kinds of constants in physics, some of them, are found experimentally with great accuracy in too expensive projects, but no matter how accurate can be measured such constant, they still have uncertainty. So imagine we made an experiment were any constant of this kind is measured , charge electron, charge to mass ratio, Newton gravitatory constant , ...

How to achieve an hypothesis proof on this constants considering that they have uncertainty ?

I has been searching this on Internet, but the nearest answer is given by the comparison of two gaussian variables with the t student distribution using:

t={|\bar{X_1}-\bar{X_2}|\over \sqrt{{\sigma_1^2\over n_1}+{\sigma_1^2\over n_2}}}
where
\sigma_i^2
are the estimators of variance of each variable

but in this form is assumed that the values n_i are known , thing that is not true for the experimental reference values , and this restrict us to always use a mean value, what if we determine this by linear fit, nonlinear fit ?
 
Physics news on Phys.org
You are correct to use statistical methods to do the comparison ... the same as with any two statistical variables.
There are a wide range of methods depending on the kind of data you have and what you want to be able to say.

Rule of thumb:
Reference values should be treated like any other measurement.
If you just want to see if two measurements agree, then take the difference and propagate the errors - if they agree then the difference will be within some stated confidence value of zero.
 
Simon Bridge said:
You are correct to use statistical methods to do the comparison ... the same as with any two statistical variables.
There are a wide range of methods depending on the kind of data you have and what you want to be able to say.

Rule of thumb:
Reference values should be treated like any other measurement.
If you just want to see if two measurements agree, then take the difference and propagate the errors - if they agree then the difference will be within some stated confidence value of zero.

Thanks for the answer it is really useful ! . After reading this, i thought the next question ... suppose that the t student test is used to do the comparison ... considering that experimental reference value is treated like any other measurent the number of degrees of freedom would be n or n-1 ?
 
How do you normally determine the degrees of freedom?
 
number of degrees of freedom ndf :
ndf = n-r

n : number of data
r : number of restrictions

usually in this kind of test i use r = 1
 
Then you have your answer.
 

Similar threads

Replies
7
Views
4K
  • Poll Poll
  • · Replies 12 ·
Replies
12
Views
6K
  • · Replies 4 ·
Replies
4
Views
1K
  • · Replies 19 ·
Replies
19
Views
7K
  • · Replies 18 ·
Replies
18
Views
4K
  • · Replies 8 ·
Replies
8
Views
3K
  • · Replies 1 ·
Replies
1
Views
3K
  • · Replies 46 ·
2
Replies
46
Views
7K
  • · Replies 0 ·
Replies
0
Views
4K
  • · Replies 12 ·
Replies
12
Views
2K