Test Hypothesis ##\it{p}##-value and ##\sigma##

  • Context: Graduate 
  • Thread starter Thread starter ChrisVer
  • Start date Start date
  • Tags Tags
    Test
Click For Summary

Discussion Overview

The discussion revolves around the relationship between p-values and standard deviations in the context of hypothesis testing, specifically comparing a null hypothesis (H_0) against an alternative hypothesis (H_1) using Z-scores. Participants explore how to interpret p-values derived from different data approaches and how these relate to standard deviations.

Discussion Character

  • Technical explanation
  • Mathematical reasoning
  • Debate/contested

Main Points Raised

  • One participant presents two p-values, p_1 = 0.105 and p_2 = 0.0002, and seeks to relate these results to standard deviations σ.
  • Another participant explains that the p-value is based on the standard normal distribution and suggests using the norminv function to find the corresponding Z-score.
  • A participant confirms that the Z-value is indeed the number of standard deviations from the mean, referencing the formula for Z.
  • Further clarification is sought regarding the definition of σ, questioning whether it refers to population or sample standard deviation and the meaning of "relating" a p-value to a standard deviation.

Areas of Agreement / Disagreement

Participants express varying levels of understanding regarding the relationship between p-values and standard deviations, with some seeking clarification on definitions and others providing technical insights. No consensus is reached on the specific statistical question or the interpretation of σ.

Contextual Notes

There are unresolved questions regarding the definitions of standard deviation in this context and the specific statistical question being addressed. The discussion reflects a need for clarity on how to relate p-values to standard deviations.

ChrisVer
Science Advisor
Messages
3,372
Reaction score
465
Let's say I have some data and I want to test the hypothesis H_0 (only background) vs the hypothesis H_1 (bkg +signal).

I did that using the ##p##-value and I got with a Z-score and two different approaches (taking all the data or the data within some mass window) the results:
\it{p}_1 =0.105
\it{p}_2 = 0.0002
How can I relate those results to standard deviations ##\sigma## ?

(I hope I used the right prefix)
 
Physics news on Phys.org
The p - value is based on the standard normal distribution, so (assuming a 2 tailed test) you can back it out using a norminv(p/2) function in most stats toolkits.
For example, norminv(.105/2, 0, 1) in MATLAB returns -1.6211, indicating that your sample data was 1.62 standard deviations away from your hypothesized mean.
 
so is that the Z-value?
Because I calculated p from Z's CDF.
 
Z can be defined as the number of standard deviations from the mean.
You can tell by the form: ##Z = \frac{ \mu-\overline x }{\sigma}##
*edit*
which can be rewritten as ## Z\sigma = \mu - \overline x##, which can be said "the difference between the sample mean and the hypothesized population mean is equal to Z standard deviations. "
 
ChrisVer said:
How can I relate those results to standard deviations ##\sigma## ?

You haven't stated a specific statistical question. Are you are referring to a problem you described in a different thread? What do you mean by \sigma? Is it a population standard deviation or a sample standard deviation? What do you mean by "relating" a p-value to a standard deviation?
 

Similar threads

Replies
20
Views
3K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 24 ·
Replies
24
Views
7K
  • · Replies 5 ·
Replies
5
Views
3K
Replies
3
Views
12K
  • · Replies 1 ·
Replies
1
Views
10K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 20 ·
Replies
20
Views
4K
  • · Replies 2 ·
Replies
2
Views
2K