Rejecting a null hypothesis without a z-score or p-value?

  • Context: Undergrad 
  • Thread starter Thread starter CynicusRex
  • Start date Start date
  • Tags Tags
    P-value
Click For Summary

Discussion Overview

The discussion revolves around the possibility of rejecting a null hypothesis without calculating a z-score or p-value, focusing on the use of confidence intervals and the empirical rule in hypothesis testing. Participants explore the implications of their reasoning and the accuracy of their interpretations.

Discussion Character

  • Debate/contested
  • Technical explanation
  • Conceptual clarification

Main Points Raised

  • One participant suggests that a 95% confidence interval can be used to reject the null hypothesis based on the estimated means of drug-administered and non-drug rats.
  • Another participant indicates that the reasoning may be correct but emphasizes the need for careful notation and understanding of the concepts involved.
  • A different participant questions whether the initial calculations are effectively equivalent to calculating a z-score, suggesting that the approach resembles a Z test.
  • One participant argues that using a confidence interval to reject a null hypothesis is excessively conservative and critiques the interpretation of the confidence interval as it does not convey probability about the mean's location.
  • Another participant clarifies that a z-score has a corresponding probability for a fixed distribution, implying that z-scores and p-values are interchangeable when properly defined.

Areas of Agreement / Disagreement

Participants express differing views on the validity of rejecting a null hypothesis without a z-score. Some agree on the need for careful interpretation of confidence intervals, while others challenge the reasoning and suggest that z-scores are necessary for accurate hypothesis testing. The discussion remains unresolved regarding the appropriateness of the initial reasoning.

Contextual Notes

Participants highlight limitations in the interpretation of confidence intervals and the potential for confusion regarding statistical notations. There is also mention of the risk of error associated with different confidence levels, indicating that the discussion is nuanced and context-dependent.

CynicusRex
Gold Member
Messages
98
Reaction score
68

u9zalnt.jpg


Is it possible to reject the null hypothesis without calculating the z-score? We estimated the
WXnYCrm.png
to be 0.05
—>2*
WXnYCrm.png
= 0.1; and 2σ = 95% (empirical rule)
Therefore there is a 95% confidence interval between 0.95 (=1.05 - 0.1) and 1.15 (=1.05+0.1)

So we can say we are 95% confident that the μx (of the drug administered rats) is between 0.95 and 1.15. Therefore we can reject the hypothesis because μ of the non-drug-rats is 1.2, which falls outside of the 95%.

Is this reasoning correct?
 
Physics news on Phys.org
Okay, my professor said it's in correct in a sense, but I need to be careful about notations. He explained why, but I'm downloading LaTeX to see his notations. I'll update this thread to avoid confusion asap.
 
Are you not simply calculating Z>2 ∴ p<0.05 rather than calculating the more accurate Z =3 and P=0.003 ?
 
Not really. I'm not calculating the Z-score directly. I'm only interpreting the results with the empirical rule and the confidence interval; so I wondered if you can reject a null hypothesis without mentioning the z-scores.
 
—>2*
WXnYCrm.png
= 0.1; and 2σ = 95% (empirical rule) Isn't this just remembering that p=0.025 for z=2 ?
Therefore there is a 95% confidence interval between 0.95 (=1.05 - 0.1) and 1.15 (=1.05+0.1) and this is saying Z=2 for sample means outside 0.95 - 1.15, therefore that is the 95% confidence range?
I'm not saying you're doing anything wrong, simply that you are doing what people do a Z test. Many people do use a simplified table that has only Z values for 95%, 97.5%, 99%, 99.5%, 99.9%, 99.95% say. You're just memorising the one value that interests you (95%) and checking that Z is greater than 2. This is fine, especially if you were working to 99.95% or better. Sometimes you may want to calculate p more precisely to give you a closer estimate of confidence: perhaps you'd be happier if your result came out at 99% rather than 96%. It doesn't look much, but the risk of error is 4x greater at 96% than 99%. (Although many people take 95% as near enough certain, I could argue that it is very dubious in some circumstances.)

 
  • Like
Likes   Reactions: CynicusRex
TheBlackAdder said:
Therefore there is a 95% confidence interval between 0.95 (=1.05 - 0.1) and 1.15 (=1.05+0.1)

So we can say we are 95% confident that the μx (of the drug administered rats) is between 0.95 and 1.15. Therefore we can reject the hypothesis because μ of the non-drug-rats is 1.2, which falls outside of the 95%.

Is this reasoning correct?

Using a confidence interval to reject a null hypothesis is excessively conservative, so it really isn't what you want to do. Moreover, your interpretation of the confidence interval is incorrect. It doesn't say anything about the probability or confidence about the location of the mean (I can easily construct a 95% confidence interval that has zero probability of containing the mean).

Why don't you want to calculate the z-score? You have all of the information you need in order to do it.
 
I was merely wondering if you can reject a null without mentioning a z-score. It has nothing to do with not wanting to do it. It's a question to make sure I'm not confusing things.
 
Hey TheBlackAdder.

A z-score (or other test statistic value) has a corresponding probability for a fixed distribution.

If you mention the distribution then you can get the z-score from the p-value provided you mention what kind of probability it is. They are - when properly defined - interchangeable.
 

Similar threads

  • · Replies 24 ·
Replies
24
Views
7K
  • · Replies 5 ·
Replies
5
Views
4K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 8 ·
Replies
8
Views
3K
  • · Replies 20 ·
Replies
20
Views
4K
  • · Replies 17 ·
Replies
17
Views
3K
  • · Replies 4 ·
Replies
4
Views
2K
Replies
2
Views
3K
Replies
3
Views
12K
  • · Replies 13 ·
Replies
13
Views
3K