Integrate data plot, combine errors including correlation

Click For Summary

Discussion Overview

The discussion revolves around the integration of a set of data points with associated errors and the challenge of combining these errors while considering the covariance matrix. Participants are exploring methods for calculating a single value and a single error from correlated data points, particularly in the context of integrating data.

Discussion Character

  • Technical explanation
  • Mathematical reasoning
  • Debate/contested

Main Points Raised

  • One participant seeks guidance on how to integrate data points while combining errors using a covariance matrix, aiming for a single value and error.
  • Another participant discusses the method for adding two correlated numbers and expresses uncertainty about extending this method to more than two correlated data points.
  • A repeated point emphasizes that the variance of the sum of correlated numbers can be calculated using the sum of squares of individual errors and twice the sum of covariances.
  • A different participant suggests using matrix techniques for general covariance calculations, referencing a formulation involving a covariance matrix and scalar components.

Areas of Agreement / Disagreement

Participants do not appear to reach a consensus on the method for integrating multiple correlated data points, and multiple competing views on the approach to error combination remain present.

Contextual Notes

The discussion includes references to covariance matrix techniques and the need for resources such as multivariate statistics textbooks, indicating potential limitations in the participants' current understanding or available materials.

venus_in_furs
Messages
19
Reaction score
1
Hello

I have a set of data points, with errors (X1 , Y1 +- deltaY1) , (X2 , Y2 +-deltaY2) etc
I have the covariance matrix for these bins

I want to integrate this set of data points: SUM_i ( Y_i * X_binWidth_i )

How do I combine the errors, taking into consideretation the covariance matrix?
So I end up with a single value and a single error?

If anyone can explain or point me in the direction of some text about this that would be very helpful thanks
 
Physics news on Phys.org
So for two numbers that are correlated, if I wanted to add them I would do
y1 with error delta1, y2 with error delta2

B = y1 + y2

And the thing i want is detalB = (delta1)^2 + (delta2)^2 + 2 cov[ y1, y2 ]

But what do I do when I am trying to add more than two numbers that are all correlated.. i.e. integrate a set of correlated data points.
 
venus_in_furs said:
So for two numbers that are correlated, if I wanted to add them I would do
y1 with error delta1, y2 with error delta2

B = y1 + y2

And the thing i want is detalB = (delta1)^2 + (delta2)^2 + 2 cov[ y1, y2 ]

But what do I do when I am trying to add more than two numbers that are all correlated.. i.e. integrate a set of correlated data points.
Basically the same thing: sum of all squares and twice the sum of all covariances gives the variance of the sum.
 
Hey venus_in_furs.

General co-variance formulas can be done using matrix techniques with the co-variance term.

There is a vCv^t formulation where C is the co-variance matrix and v represents the scalar component of the random variable.

It mimics the variance results that are proven with the normal Var[] operator but it allows it to be done with matrices and vectors in an arbitrary fashion.

A multi-variate statistics textbook should have it (or any other similar resource).
 

Similar threads

  • · Replies 4 ·
Replies
4
Views
3K
Replies
28
Views
4K
  • · Replies 5 ·
Replies
5
Views
2K
  • · Replies 9 ·
Replies
9
Views
3K
  • · Replies 40 ·
2
Replies
40
Views
5K
  • · Replies 8 ·
Replies
8
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 4 ·
Replies
4
Views
2K
  • · Replies 11 ·
Replies
11
Views
3K
  • · Replies 4 ·
Replies
4
Views
2K