Error propagation for non-normal errors

Click For Summary

Discussion Overview

The discussion revolves around the propagation of errors in measurements that exhibit non-normal distributions, specifically log-normal errors. Participants explore the implications of these distributions on traditional error propagation methods, particularly in the context of summing data points and applying these methods to both linear and nonlinear functions.

Discussion Character

  • Debate/contested
  • Technical explanation
  • Mathematical reasoning

Main Points Raised

  • One participant questions the applicability of standard error propagation rules for non-normal errors, suggesting that the usual formula may not hold due to the derivation being based on Gaussian distributions.
  • Another participant asserts that the standard error formula does not require a normal distribution, emphasizing the independence of measurement errors as the key condition.
  • A participant expresses confusion about whether the distribution of errors affects the propagation of errors in nonlinear functions, seeking clarification on this point.
  • Discussion includes a reference to the delta method and the use of Taylor expansions in error propagation, noting that higher order terms may depend on the statistics of the variable involved.
  • One participant suggests using error propagation for the logarithm of the independent variable to address the log-normal distribution of errors.

Areas of Agreement / Disagreement

Participants express differing views on the applicability of traditional error propagation methods to non-normal errors, with no consensus reached on the implications for linear versus nonlinear functions.

Contextual Notes

Participants highlight the importance of independence among measurement errors and the potential complexities introduced by nonlinear functions. The discussion reflects uncertainty regarding the treatment of log-normal errors in the context of error propagation.

SamanthaYellow
Messages
5
Reaction score
0
I have several measurements taken over a time series. Each data point has a standard error value. I need to sum up the data points, and determine the error associated with that sum. The error values across the time series are non-normal, so I'm assuming that I can't use the usual error propagation rules (i.e., SE_total = √(SE1^2 + SE2^2 +...) ). A log-transform of the errors shows that the errors are log-normal though. I'm not sure how to approach this. Is there a way to sum log-normal errors?
 
Physics news on Phys.org
The formula for standard error does not require a normal distribution. The only condition is that the measurement errors be independent.
 
I thought that since the formula for error propagation is derived for a Gaussian distribution, the typical summation of errors in quadrature is not applicable when errors are not normally distributed.
 
The typical derivation is based on the the following (two variables - generalizable to n):
Simplify writing by assuming means are 0. E((X+Y)²)=E(X²)+2E(XY)+E(Y²). IF X and Y are independent (uncorrelated is enough), E(XY)=E(X)E(Y)=0.
 
Thank you for your replies. I've done more searching on this topic and it seems I'm not alone in my confusion about this. I want to make sure I've got this right: even though the distribution of the errors is non-normal, the usual error propagation rules are applicable since the function that I'm propagating errors for is a simple sum (i.e., linear). Does the distribution of errors come into play for propagating errors for more complex, nonlinear functions?
 
Not necessarily. E((XY)^2)=E(X^2)E(Y^2), so you have variances multiplying, not adding.
 
Statisticians call this the delta method, and another important assumption is that you can use a lowest order Taylor expansion. So ## Var(f(x))=\langle f^2(x)-\langle f(x)\rangle^2\rangle=\langle (f(0)+f'(0)x+f''(0)x^2/2)^2+\ldots -\langle f(0)+f'(0)x+f''(0)x^2/2+\ldots)\rangle^2 \rangle=f'(0)^2 \langle x^2 \rangle ##+ higher order terms.
The higher order terms depend not only on the statistics of x but also on the Taylor series. It might be that they all disappear for a Gaussian, as higher order correlation functions can all be expressed in terms of ##E(x^2)##.

You say that your error is lognormal distributed?
So why don't you use error propagation for the logarithmized independent variable , i.e. replacing Var(f(y) by ##Var(f(e^x))##?
 

Similar threads

  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 31 ·
2
Replies
31
Views
3K
  • · Replies 5 ·
Replies
5
Views
2K
  • · Replies 30 ·
2
Replies
30
Views
4K
  • · Replies 9 ·
Replies
9
Views
5K
  • · Replies 8 ·
Replies
8
Views
3K
  • · Replies 56 ·
2
Replies
56
Views
4K
  • · Replies 19 ·
Replies
19
Views
8K
Replies
15
Views
2K
  • · Replies 8 ·
Replies
8
Views
6K