Putting upper bounds from a null result

  • #1
kelly0303
561
33
Hello! If I have a measurement of a (dimensionless) parameter, ##a##, say 998 +/- 3 and the theoretical prediction of that parameter (assuming known physics) is 1000 +/- 4. Let's say that I want to set limits on a new parameter (not included in the theoretical calculations), call it ##\alpha##, that would contribute additively to ##a##. By comparing the experiment with the theory, I get a = 2 +/- 5 (the errors are all gaussian and I added them in quadrature). I want to set, let's say, a 95% upper bound on the value of a. In general, I could just say a < 12. However, in my case I know that ##a## has to be positive. How would I define the upper bound in this case, knowing that part of the range allowed by a = 2 +/- 5 is in practice not allowed by the physical theory? Also, I am not totally sure if my range would be (1000-998) +/- 5 = 2 +/- 5 or (998-1000) +/- 5 = -2 +/- 5. How do I decide which one to use. The first one would be the conservative choice, but I am not sure if it is not too conservative). Thank you!
 
Physics news on Phys.org
  • #2
kelly0303 said:
the errors are all gaussian … I know that ##a## has to be positive.
I don’t see how this is possible.
 
  • #3
Dale said:
I don’t see how this is possible.
I am not sure I understand
 
  • #4
kelly0303 said:
I am not sure I understand
How can it be true both that the errors are Gaussian and also that they must be positive? The Gaussian distribution is not strictly positive.
 
  • #5
Dale said:
How can it be true both that the errors are Gaussian and also that they must be positive? The Gaussian distribution is not strictly positive.
The errors on the theoretical calculations and on the measurement are Gaussian. The value of the new physics parameter must be positive. For example, the experimental value can be from a simple counting experiment. If the measured value is, say, 10000 and (I ignore the systematic uncertainties) the statistical error (assuming a Poisson process) is 100 (and it is very close to a Gaussian distribution) i.e. the measured value is 10000 +/- 100. The theoretical value can be, for example also 10000 +/- 100. Now I want to use this measurement to set upper bounds on a possible (positive value) new physics effect, given that its effect was not big enough to make the experiment deviate from the theoretical predictions (which don't include the new physics effect). I can share several papers where this is applied to some measurements if my explanation is not clear. Thank you!
 
  • #6
Theoretically, the errors on the measurement of a positive parameter cannot be gaussian, because gaussians can be unboundedly negative. That said it's common to just ignore this and use a bunch of math that assumes gaussians are errors, and somehow by magic everything is basically correct anyway in a lot of examples.

Here you know it's not magically correct, which means if you want to say something mathematical, the details of exactly what you did are going to be important.
 
  • #7
Office_Shredder said:
Theoretically, the errors on the measurement of a positive parameter cannot be gaussian, because gaussians can be unboundedly negative. That said it's common to just ignore this and use a bunch of math that assumes gaussians are errors, and somehow by magic everything is basically correct anyway in a lot of examples.

Here you know it's not magically correct, which means if you want to say something mathematical, the details of exactly what you did are going to be important.
But how do I do this in practice? Basically in my case I have a measurement and a theoretical calculation with gaussian errors. These values are from literature, so there is not much I can do about it. I want to test a new physics scenario which changes the expected results in a given way that depends on a parameter that needs to be positive. So the effect of this new physics can be written as ##k\alpha##, where ##k## can be calculated (we can ignore the uncertainty on k and assume it's just a constant) and ##\alpha > 0##. How do I use these (experimental and theoretical values and uncertainties, as well as k) to set an upper limit on ##\alpha## (assuming that the theory and experiment are consistent within uncertainties). Thank you!
 
  • #8
It would help if you had more specifics about what you're doing. There also might be field standards techniques that you should be using.

Here's an example of a thing I might personally do. Let's suppose I have a 100 meter track and I use a radar to measure the speed of something traversing the track at constant speed. My radar gun says that it is traveling at ##20 \pm 3## meters per second. I want to think about this in terms of time traveled. Obviously if it's 20 on the nose it took 5 seconds to travel the whole length.

The stdev of 3 means there's a 95 percent chance that we're within 2 stdevs and hence the speed is in ##[14,26]##. This means the time it takes, with 95 percent probability, is in the interval ##[3.84,7.14]## seconds (100/26 and 100/14). Note this is not symmetric around 5. You might be able to do something similar where you construct a confidence interval for what the final parameter is
 

1. What does "putting upper bounds from a null result" mean?

This term refers to the process of defining the maximum possible value or limit of a certain parameter when an experiment does not yield a positive result or detectable effect. Essentially, it involves determining how large or intense a phenomenon could be before it would have been detected by the experiment, thus setting an upper limit based on the sensitivity and scope of the experimental setup.

2. Why is it important to establish upper bounds from null results?

Establishing upper bounds from null results is crucial in scientific research because it helps to define the parameters within which theories must operate. It can rule out or constrain certain theoretical models or hypotheses that predict effects larger than the established bounds. This process is important for refining scientific models and guiding future experimental designs.

3. How are upper bounds calculated from null results?

Upper bounds are typically calculated by analyzing the sensitivity and detection threshold of the experiment. Researchers estimate the maximum strength or size of an effect that could have gone undetected given the experimental conditions. This involves statistical analysis and often relies on confidence levels (e.g., 95% confidence interval) to provide a probabilistic assessment of the upper limit.

4. What are some common challenges in setting upper bounds from null results?

One of the main challenges is ensuring that the experiment has sufficient sensitivity and coverage to make meaningful upper bound estimations. Inadequate experimental design, limited data, or poor calibration can lead to unreliable bounds. Another challenge is the interpretation of these bounds, as they depend heavily on the assumptions made during the experiment and the statistical methods used.

5. Can you provide an example of a scenario where upper bounds from a null result were particularly influential?

An example is in the field of particle physics, such as the search for dark matter particles. Experiments like those conducted with Large Underground Xenon (LUX) detector have not yet detected direct evidence of dark matter particles, but they have been able to set stringent upper limits on the properties of these particles, such as their mass and interaction cross-section with normal matter. These limits are crucial for ruling out certain theoretical models of dark matter and guiding future research efforts in the field.

Similar threads

  • Set Theory, Logic, Probability, Statistics
Replies
0
Views
463
  • Set Theory, Logic, Probability, Statistics
Replies
4
Views
1K
  • Set Theory, Logic, Probability, Statistics
2
Replies
56
Views
2K
  • Advanced Physics Homework Help
Replies
2
Views
830
  • Set Theory, Logic, Probability, Statistics
Replies
2
Views
1K
  • Set Theory, Logic, Probability, Statistics
Replies
30
Views
2K
  • Set Theory, Logic, Probability, Statistics
Replies
1
Views
743
  • Set Theory, Logic, Probability, Statistics
Replies
21
Views
2K
Replies
85
Views
4K
  • Atomic and Condensed Matter
Replies
1
Views
960
Back
Top