Propagation of error with sliding window of measurement

Click For Summary
SUMMARY

The discussion focuses on the propagation of error when calculating the standard deviation from a sliding window of measurements. Specifically, it addresses the challenge of overestimating error when averaging standard deviations from overlapping sets of 50 events within a total of 400 measurements. The proposed method involves calculating the uncertainty for each measurement and deriving a simplified expression for the final result, which ideally should not depend directly on the original 400 values but rather on the 350 calculated values.

PREREQUISITES
  • Understanding of standard deviation and its calculation
  • Knowledge of error propagation techniques
  • Familiarity with sliding window analysis
  • Basic statistics, particularly in the context of measurement uncertainty
NEXT STEPS
  • Research advanced error propagation methods in statistics
  • Learn about sliding window techniques in time series analysis
  • Explore the concept of uncertainty in statistical measurements
  • Investigate methods for simplifying complex statistical expressions
USEFUL FOR

Statisticians, data analysts, researchers in experimental sciences, and anyone involved in measurement analysis and error propagation techniques.

DethLark
Messages
9
Reaction score
0
Hello, I don't seem to know how to ask google this question so I thought I'd see if I could get an answer from here.

Say I have 400 measurements of some variable. I take a sliding window of 50 events and take the standard deviation of each set of 50 events. That would be 350 measurements. Now I want to take the first and second 175 events, take the average of each, and subtract them.

Normally to propagate the error on this final measurement you would, for each side, find the error of each standard deviation std/sqrt(2*(50-1)) then take use sqrt(sum of the squares)/175 to find the error on the average std.dev. for each side. Then use sqrt(sum of the squares) of these two errors for the final error on the subtraction of the averages.

The problem with this is that each measurement of the std.dev shares 49 events with the previous so this method would overestimate the final error. What to do?
 
Physics news on Phys.org
Why do you want to compare the floating-average values? Can you compare the original values?

If all values are expected to follow the same distribution, you can calculate the uncertainty for each measurement (out of 400), find a big expression for your final result, and calculate its uncertainty based on the uncertainties of each measurement. I would expect that this formula can be simplified a lot, but I don't know how the final result would look like. In the best case, it does not depend directly on the original 400 values, but just on your 350 values.
 

Similar threads

  • · Replies 1 ·
Replies
1
Views
1K
  • · Replies 22 ·
Replies
22
Views
2K
  • · Replies 19 ·
Replies
19
Views
8K
  • · Replies 18 ·
Replies
18
Views
4K
  • · Replies 21 ·
Replies
21
Views
3K
  • · Replies 25 ·
Replies
25
Views
3K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 9 ·
Replies
9
Views
5K
Replies
28
Views
4K
  • · Replies 2 ·
Replies
2
Views
2K