How to statistically calculate the final value?

Click For Summary
SUMMARY

This discussion focuses on the statistical calculation of final values, particularly in the context of measuring acceleration. Key formulas mentioned include the calculation of uncertainty using the formula $$\Delta a=\frac{a_1 \frac{1}{{\Delta a_1}^2}+a_2 \frac{1}{{\Delta a_2}^2}}{\frac{1}{{\Delta a_1}^2}+\frac{1}{{\Delta a_2}^2}$$ and the standard deviation formula $$\sigma=\sqrt{{\sigma_A}^2+{\sigma_B}^2}$$. The discussion emphasizes the importance of having at least three data points for meaningful uncertainty estimation and introduces statistical software for estimating parameters and uncertainties. Methods such as the $$\chi^2$$ fit and bootstrap techniques are also highlighted for more complex error analysis.

PREREQUISITES
  • Understanding of statistical error analysis
  • Familiarity with formulas for calculating uncertainty
  • Knowledge of statistical software for parameter estimation
  • Basic principles of regression analysis, including $$\chi^2$$ fitting
NEXT STEPS
  • Research the application of statistical software for parameter estimation in experimental physics
  • Learn about the bootstrap method for error analysis in non-Gaussian distributions
  • Study the principles of $$\chi^2$$ fitting and its applications in data analysis
  • Explore advanced techniques for calculating weighted means and their implications in statistical analysis
USEFUL FOR

Researchers, physicists, and statisticians involved in experimental data analysis, particularly those focusing on measurement uncertainties and statistical methods for parameter estimation.

Lotto
Messages
253
Reaction score
16
TL;DR
Let us say we have conducted two measurments with aim to determine an acceleration of our object. We have from both measurements:
1.##t_1 \pm \Delta t_1##, ##s_1 \pm \Delta s_1##
2. ##t_2\pm \Delta t_2##, ##s_2 \pm \Delta s_2##.

To calculate ##a## we use ##s=\frac 12 a t^2##.

How to determine the final value of ##a \pm \Delta a##?
My steps would be that I would first calculated ##a_1## and ##a_2##, determined by using that formula with partial derivatives its errors, and then I would made an arithmetic mean of ##a_1## and ##a_2##. I am not sure how to determine the final error, but I think I can use this formula

##\Delta a=\frac{a_1 \frac{1}{{\Delta a_1}^2}+a_2 \frac{1}{{\Delta a_2}^2}}{\frac{1}{{\Delta a_1}^2}+\frac{1}{{\Delta a_2}^2}}##.

But shouldn't I also do a standard deviation of ##a_1## and ##a_2## from ##a## and then calculate the final error by using a general formula

##\sigma=\sqrt{{\sigma_A}^2+{\sigma_B}^2}##?
 
Physics news on Phys.org
When you only have two measurements, a statistically calculated uncertainty is not very meaningful. You have no clue whether the value of the acceleration from a third measurement will be higher than the larger value, lower than the smaller value or in-between the two. In my opinion, you need at least three data points before you start worrying about uncertainties. If you have only two, I would say consider half the difference between the two values as an estimate of your uncertainty. Uncertainties are fuzzy, the fewer data points you have, the fuzzier they become.
 
  • Like
Likes   Reactions: Dale
Lotto said:
To calculate ##a## we use ##s=\frac 12 a t^2##.
This formula assumes that the acceleration is constant, the velocity at ##t=0## is 0, and the speed at ##t=0## is also 0. Is that valid?
 
  • Like
Likes   Reactions: nasu
kuruman said:
When you only have two measurements, a statistically calculated uncertainty is not very meaningful. You have no clue whether the value of the acceleration from a third measurement will be higher than the larger value, lower than the smaller value or in-between the two. In my opinion, you need at least three data points before you start worrying about uncertainties. If you have only two, I would say consider half the difference between the two values as an estimate of your uncertainty. Uncertainties are fuzzy, the fewer data points you have, the fuzzier they become.
OK, so let's say I have 10+ measurements and that we suppose that the movement is with a constant acceleration. All I want to know is the general principle I can apply in such cases, my measuring of the acceleration was just an example.
 
Last edited:
Lotto said:
OK, so let's say I have 10+ measurements and that we suppose that the movement is with a constant acceleration. All I want to know is the general principle I can apply in such cases, my measuring of the acceleration was just an example.
OK, so in that case you will be using a statistical software to estimate your acceleration (or whatever). The statistical software will give you the estimate of your parameter ##a## a standard error or some other estimate of the uncertainty of ##a##. You can just use that directly as ##\Delta a## if you think that only the statistical errors are important.

If you believe that there are also important systematic uncertainties then you can include them as $$\Delta a =\sqrt{\Delta a_{\text{statistical}}^2+\Delta a_{\text{systematic}}^2}$$
 
  • Like
Likes   Reactions: vanhees71
Are you sure that you have a different error on all ##s## and ##t## measurements? I am asking, because it really makes it more complicated than high school math. Generally you would want to convert errors in x-direction into y-errors and than proceed normally. If this is not possible or the errors in ##s## and ##t## are not Gaussian or the conventional methods will yield a bias in your particular experiment, then you have to do a bootstrap.
One of the conventional methods is a ##\chi^2## fit. In your case I would minimize $$\chi^2=\sum_i \frac{(s_i-\frac{1}{2}at_i^2)^2}{\sigma^2_{s_i} +(\frac{\partial 0.5at^2}{\partial t^2})^2\sigma^2_{t^2_i}}$$. Note that I use the error of ##t_i^2## not just ##t_i##. Now you would have to find ##\frac{\partial \chi^2}{\partial a}##, set it equal to 0 and solve for a. If the errors on ##s## and ##t## are Gaussian, then you can use something like $$\Delta a=\sqrt{\sum_i (\partial_{s_i} a \Delta s_i)^2+(\partial_{t_i^2} a \Delta t_i^2)^2}$$, but to be safe better derive it yourself.
 
  • Like
Likes   Reactions: vanhees71 and Dale
Leopold89 said:
Are you sure that you have a different error on all ##s## and ##t## measurements? I am asking, because it really makes it more complicated than high school math. Generally you would want to convert errors in x-direction into y-errors and than proceed normally. If this is not possible or the errors in ##s## and ##t## are not Gaussian or the conventional methods will yield a bias in your particular experiment, then you have to do a bootstrap.
One of the conventional methods is a ##\chi^2## fit. In your case I would minimize $$\chi^2=\sum_i \frac{(s_i-\frac{1}{2}at_i^2)^2}{\sigma^2_{s_i} +(\frac{\partial 0.5at^2}{\partial t^2})^2\sigma^2_{t^2_i}}$$. Note that I use the error of ##t_i^2## not just ##t_i##. Now you would have to find ##\frac{\partial \chi^2}{\partial a}##, set it equal to 0 and solve for a. If the errors on ##s## and ##t## are Gaussian, then you can use something like $$\Delta a=\sqrt{\sum_i (\partial_{s_i} a \Delta s_i)^2+(\partial_{t_i^2} a \Delta t_i^2)^2}$$, but to be safe better derive it yourself.
And if the systematic errors for ##t## and ##s## were all the same, so ##\Delta t##, ##\Delta s##, what would it looked like?

Should I calculate a standard deviation of my values ##a_1, a_2, ...## and calculate a weighted arithmetic mean of errors ##\Delta a_1, \Delta a_2, ...##? I would then add them by using that formula with square roots. Would it be a legal way to do it?

And the final ##a## would be just an arithmetic mean of ##a_1, a_2, ...##?
 
Lotto said:
And if the systematic errors for ##t## and ##s## were all the same, so ##\Delta t##, ##\Delta s##, what would it looked like?

Should I calculate a standard deviation of my values ##a_1, a_2, ...## and calculate a weighted arithmetic mean of errors ##\Delta a_1, \Delta a_2, ...##? I would then add them by using that formula with square roots. Would it be a legal way to do it?

And the final ##a## would be just an arithmetic mean of ##a_1, a_2, ...##?
Possible. You could use the GLS, after converting ##\Delta t## to ##\Delta s##. Then you can try to rewrite the estimator ##\hat \beta## such that it looks like an average.

P.S. No, it does not work with the mean. Here is an example, where you can see that the estimator is not the mean.
 
Last edited:

Similar threads

  • · Replies 22 ·
Replies
22
Views
2K
  • · Replies 8 ·
Replies
8
Views
3K
  • · Replies 3 ·
Replies
3
Views
1K
  • · Replies 30 ·
2
Replies
30
Views
2K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 6 ·
Replies
6
Views
3K
  • · Replies 3 ·
Replies
3
Views
3K
  • · Replies 23 ·
Replies
23
Views
3K
  • · Replies 0 ·
Replies
0
Views
3K
  • · Replies 1 ·
Replies
1
Views
2K