Hypothesis testing and the power of the test

In summary: For more detail, see : POWER.In summary, the power of a statistical test is the probability of correctly rejecting the null hypothesis when it is false. It is related to the type II error or beta, with the formula power = 1 - beta. This means that an increase in power represents an improvement in the performance of a statistical test.
  • #1
adeel
45
0
I am having trouble understanding the concept of the power of the test. Here is a sample question with solution:

A company wants to test if average weekly demand is more than 2000 lbs. Test is to be carried out at 5% level of significance, and an estimate of the population variance is 1,000,000. What is the power of the test if the true mean is 2300 lbs.

So here is the sol'n (u represents population mean, and x represents x bar, sample mean, z is z-score, based on 5% is 1.645):

Hypothesis statement: Null: u <= 2000 Alternative: u > 2000

xcritical = u + zo (o is standard deviation, calculation shows it to be 200)
xcritical = 2000 + 1.645(200)
xcritical = 2349

Power at 2300

P(xcritical > 2349) = P (z > 0.145)
P(z > 0.145) = 0.5 - 0.0596 = 0.4404

So the thing i don't understand, is that if the power of the test is the probability of correctly rejecting the null hypothesis when it is false, why do we calculate the area beyond the z-score and call that the power of the test. Isnt the area beyond supposed to be Beta, the probability of making a type II error?


Any help is greatly appreciated
 
Physics news on Phys.org
  • #2
http://linkage.rockefeller.edu/wli/glossary/stat.html#p
POWER
This is the probability that a statistical test will detect a defined pattern in data and declare the extent of the pattern as showing STATISTICAL SIGNIFICANCE. POWER is related to TYPE-2 ERROR by the simple formula : POWER = (1-BETA) ; the motive for this re-definition is so that an increase in value for POWER shall represent improvement of performance of a STATISTICAL TEST. For more detail, see : BETA.
BETA
Also known as TYPE-2 ERROR, BETA is the complement to POWER : BETA = (1-POWER). This is the probability that a statistical test will generate a false-negative error : failing to assert a defined pattern of deviation from a null pattern in circumstances where the defined pattern exists.
 
  • #3
.

The power of a test is the probability of correctly rejecting the null hypothesis when it is false. In other words, it is the probability of correctly detecting a true effect or difference. In the example given, the true mean is 2300 lbs, which is greater than the hypothesized mean of 2000 lbs. This means that if the true mean is 2300 lbs, the null hypothesis (u <= 2000) is false.

The area beyond the z-score (0.145 in this case) is the probability of observing a sample mean greater than the critical value (2349) when the true mean is 2300 lbs. This is the same as the power of the test, because it represents the probability of correctly rejecting the null hypothesis (u <= 2000) when it is false (true mean is 2300).

The probability of making a type II error (incorrectly accepting the null hypothesis when it is false) is represented by the area between the critical value and the true mean. In this case, that area is 0.0596, which is the probability of making a type II error.

So, to summarize, the power of the test is the probability of correctly detecting a true effect or difference (represented by the area beyond the critical value), while the probability of making a type II error is represented by the area between the critical value and the true mean. Hope this helps clarify the concept of power in hypothesis testing.
 

1. What is a hypothesis test?

A hypothesis test is a statistical method used to determine whether a hypothesis about a population is likely to be true or not based on a sample of data.

2. How do you set up a hypothesis test?

The first step in setting up a hypothesis test is to clearly define the null hypothesis (H0) and the alternative hypothesis (Ha). Then, you must choose an appropriate test statistic and determine the level of significance alpha (α). Finally, you collect data and calculate the p-value to determine the outcome of the test.

3. What is the power of a hypothesis test?

The power of a hypothesis test is the probability of correctly rejecting the null hypothesis when it is false. In other words, it is the ability of the test to detect a true difference or relationship between variables. A higher power indicates a more sensitive test.

4. How is the power of a test affected by sample size?

The power of a test is directly affected by sample size. As the sample size increases, the power of the test also increases. A larger sample size allows for a more accurate representation of the population, making it easier to detect a true difference or relationship.

5. Can a hypothesis test have 100% power?

No, it is not possible for a hypothesis test to have 100% power. The power of a test is affected by various factors such as sample size, effect size, and alpha level. Even with a large sample size and a strong effect size, there is always a small chance of error in the test results.

Similar threads

  • Set Theory, Logic, Probability, Statistics
Replies
22
Views
2K
  • Set Theory, Logic, Probability, Statistics
Replies
20
Views
3K
  • Set Theory, Logic, Probability, Statistics
Replies
13
Views
2K
  • Set Theory, Logic, Probability, Statistics
Replies
1
Views
2K
  • Calculus and Beyond Homework Help
Replies
7
Views
857
  • Set Theory, Logic, Probability, Statistics
Replies
5
Views
1K
  • Set Theory, Logic, Probability, Statistics
Replies
8
Views
2K
  • Set Theory, Logic, Probability, Statistics
Replies
1
Views
852
  • Set Theory, Logic, Probability, Statistics
Replies
1
Views
2K
  • Set Theory, Logic, Probability, Statistics
Replies
4
Views
925
Back
Top