Weighted least-squares fit error propagation

Click For Summary
SUMMARY

The discussion focuses on the weighted least-squares fit for linear regression, specifically addressing the propagation of uncertainties in the constants A and B derived from measurements of two variables, x and y. The weights are defined as w_{i} = 1/\sigma_{i}, where \sigma_{i} represents the uncertainties in the y measurements. The best estimates for A and B are calculated using the provided formulas, and the uncertainties in these constants are derived using error propagation techniques, resulting in \sigma_{A} = \sqrt{\frac{\Sigma w x^{2}}{\Delta}} and \sigma_{B} = \sqrt{\frac{\Sigma w}{\Delta}}.

PREREQUISITES
  • Understanding of linear regression and least-squares fitting
  • Familiarity with error propagation methods
  • Knowledge of statistical weights in measurements
  • Basic calculus and algebra for handling sums and derivatives
NEXT STEPS
  • Study the derivation of the weighted least-squares method in detail
  • Learn about error propagation in more complex systems
  • Explore the application of statistical weights in experimental physics
  • Investigate software tools for performing weighted least-squares fitting, such as Python's SciPy library
USEFUL FOR

Students and researchers in physics, data analysts, and statisticians who are involved in linear regression analysis and need to understand error propagation in measurements with varying uncertainties.

mbigras
Messages
61
Reaction score
2

Homework Statement


Suppose we measure N pairs of values (xi, yi) of two variables x and y that are supposed to statisfy a linear relation y = A + Bx suppose the xi have negligible uncertainty and the yi have different uncertainties \sigma_{i}. We can define the weight of the ith measurement as w_{i} = 1/\sigma_{i}. Then the best estimates of A and B are:

<br /> A = \frac{\Sigma w x^{2}\Sigma w y - \Sigma w x \Sigma w x y}{\Delta}\\<br /> B = \frac{\Sigma w \Sigma w x y - \Sigma w x \Sigma w y}{\Delta}\\<br /> \Delta = \Sigma w \Sigma x^{2} - \left(\Sigma w x \right)^{2}<br />

Use error propagation to prove that the uncertainties in the constants A and B are given by

<br /> \sigma_{A} = \sqrt{\frac{\Sigma w x^{2}}{\Delta}}\\<br /> \sigma_{B} = \sqrt{\frac{\Sigma w}{\Delta}}<br />

Homework Equations



rules for sums and differences
<br /> q = x \pm z\\<br /> \delta q = \sqrt{(\delta x)^{2} + (\delta z)^{2}}\\<br />
rules for products and quotients
<br /> \delta q = \sqrt{(\delta x/x)^{2} + (\delta z/z)^{2}}\\<br />

The Attempt at a Solution


What I'm thinking is because the uncertainty in x is negligible it will be treated like a constant. I'm not sure how to deal with all these sums. I feel like I don't know how to approach this question.
 
Last edited:
Physics news on Phys.org
Try calculating E(A2) etc. The negligible uncertainty in the x allows you to treat the Δ denominators as constant.
 

Similar threads

  • · Replies 7 ·
Replies
7
Views
877
Replies
7
Views
1K
  • · Replies 7 ·
Replies
7
Views
2K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 1 ·
Replies
1
Views
3K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 5 ·
Replies
5
Views
2K
  • · Replies 11 ·
Replies
11
Views
1K
  • · Replies 9 ·
Replies
9
Views
2K
  • · Replies 2 ·
Replies
2
Views
2K