How Do Correlations Between Uncertainties Affect Analyses?

  • Context: Graduate 
  • Thread starter Thread starter ChrisVer
  • Start date Start date
Click For Summary
SUMMARY

The discussion centers on the correlation between statistical and systematic uncertainties in experimental analyses, particularly in the context of particle physics, such as the ATLAS experiment. It establishes that while statistical and systematic uncertainties can be correlated, their interpretation remains complex and often ambiguous due to bureaucratic standards. The correlation between uncertainties, such as the common magnetic field uncertainty affecting transverse momentum measurements, can significantly influence analysis outcomes. Understanding these correlations is essential for accurate data interpretation in experimental physics.

PREREQUISITES
  • Understanding of statistical and systematic uncertainties
  • Familiarity with correlation and covariance matrices
  • Knowledge of particle physics, specifically the ATLAS experiment
  • Basic concepts of random variables and their relationships
NEXT STEPS
  • Research the role of correlation and covariance matrices in experimental data analysis
  • Explore the implications of systematic errors in laboratory experiments
  • Study the measurement techniques used in particle physics, particularly in the ATLAS experiment
  • Investigate the statistical methods for analyzing uncertainties in experimental results
USEFUL FOR

Researchers, physicists, and data analysts involved in experimental physics, particularly those working with uncertainties in measurements and data interpretation.

ChrisVer
Science Advisor
Messages
3,372
Reaction score
465
I am always confused when reading about correlation between uncertainties.
I have some basic questions:
1. Can statistical and systematic uncertainties be correlated? [Well they can but I don't understand how this can be interpreted]
2. What are correlations telling us ? obviously a correlation is not giving us any relation [or causation].
3. One example which has confused me:
the transverse momentum of charged particles in ATLAS for example can be measured by looking at the charged particle trajectories within the magnetic field.
The magnetic field's uncertainty \sigma_B is then common for all particles, and this makes their transverse momenta measurement correlated. How does this affect the analyses?
 
Physics news on Phys.org
ChrisVer said:
I am always confused when reading about correlation between uncertainties.

It's difficult to answer questions about "uncertainties" from the point of view of a forum on "Set Theory, Logic, probability, Statistics" because "uncertainties" in laboratory experiments seems to be a topic that results from an interaction between mathematics and bureaucracy. For example, http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3387884/ says:

Systematic error (bias) can, at least theoretically, be eliminated from the result by an appropriate correction.
...
Random errors may be analysed statistically while systematic errors are resistant to statistical analysis. Systematic errors are generally evaluated by non-statistical procedures.
...
but also says:
The uncertainty in the reported value of the measurand comprises the uncertainty due to random errors and the uncertainty of any corrections for systematic errors.

I suppose a bureaucratic document needs feel no shame in applying the term "uncertainty" to "corrections of systematic errors" while also saying that systematic errors are "are generally evaluated by non-statistical procedures". However that kind of language renders the relation of "systematic uncertainties" to anything defined in statistics completely ambiguous.

People doing a specific experiments probably figure out how to apply bureaucratic standards in reporting their work by copying what predecessors have done or by negotiating with the people that write the standards.


I have some basic questions:
1. Can statistical and systematic uncertainties be correlated? [Well they can but I don't understand how this can be interpreted]

I know what "correlated" means from the viewpoint of "Set Theory, Logic, Probability, Statistics". It is a term that is applicable to random variables. But what do bureaucratic documents mean by "correlated"?

2. What are correlations telling us ? obviously a correlation is not giving us any relation [or causation].

The existence of a non-zero correlation between two random variables tells us they are not independent. If the random variables represent "noise" added to deterministic variables that are approximately related by a linear function then the correlation tells us something about the slope of linear function. If the deterministic variables are related by a very non-linear function, what correlation tells us is not clear.

3. One example which has confused me:
the transverse momentum of charged particles in ATLAS for example can be measured by looking at the charged particle trajectories within the magnetic field.
The magnetic field's uncertainty \sigma_B is then common for all particles, and this makes their transverse momenta measurement correlated. How does this affect the analyses?

Some other forum member may be familiar with what "the analysis" is. Is the physics complicated ?
 
Hey ChrisVer.

Correlation acts on a random variable (or random vector to be a bit more precise) and that vector can contain any distribution.

You can correlate things that are not just raw value data like uncertainties but the data itself will have that structure.

If you have vectors of uncertainties then you can correlate them.

Usually though - the way to assess relations between variances and uncertainties in general is via the correlation and/or covariance "matrix" in a general capacity.
 

Similar threads

  • · Replies 24 ·
Replies
24
Views
3K
  • · Replies 4 ·
Replies
4
Views
2K
  • · Replies 19 ·
Replies
19
Views
3K
  • · Replies 178 ·
6
Replies
178
Views
10K
  • · Replies 11 ·
Replies
11
Views
3K
  • · Replies 21 ·
Replies
21
Views
4K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 39 ·
2
Replies
39
Views
5K
Replies
1
Views
2K
  • · Replies 7 ·
Replies
7
Views
2K