Follow-Up on F-Test in Multi-Linear Regression

Click For Summary
SUMMARY

The discussion focuses on the application of the F-test in multi-linear regression analysis, specifically testing the null hypothesis (H0) that all coefficients (a1, a2, ..., an) are equal to zero against the alternative hypothesis (H1) that at least one coefficient is non-zero. It is established that rejecting H0 indicates at least one significant predictor in the model, but does not specify which coefficients are non-zero. To identify significant coefficients, participants recommend performing pairwise comparisons and applying multiple comparison tests, such as the Bonferroni correction, to determine which coefficients differ from zero.

PREREQUISITES
  • Understanding of multi-linear regression analysis
  • F-test application in hypothesis testing
  • Knowledge of pairwise comparison techniques
  • Familiarity with Bonferroni correction for multiple comparisons
NEXT STEPS
  • Research the application of pairwise comparison tests in regression analysis
  • Learn about the Bonferroni correction and its implementation
  • Explore alternative multiple comparison methods, such as Tukey's HSD
  • Study the interpretation of regression coefficients and confidence intervals
USEFUL FOR

Data analysts, statisticians, and researchers involved in regression modeling and hypothesis testing who seek to understand the significance of predictors in multi-linear regression.

WWGD
Science Advisor
Homework Helper
Messages
7,802
Reaction score
13,105
Hi All,
Say we want to linearly regress Y (dependent) against ## X_1, X_2,..., X_n ## (Independent) , all numerical variables to get a model ## Y=a_1X_1+...+a_n X_n ## .

Then we test ## H_0 ## for whether :

##H_0: 0= a_1= a_2 =...=a_n ##

## H_1 : a_i \neq 0 ## for some ## i=1,2,..,n ##

( This is a generalization on the test for equality of 2 means to equality of means, to zero )

Could someone remind me what one does when one rejects ## H_0 ## in terms of deciding, figuring
out which of the ## a_i' ##s is non-zero , other than considering the t-intervals for each of the ##a_i ## 'sand checking whether the intervals (a,b) contain 0, i.e., whether a<0<b ?

EDIT IIRC, we then do a pairwise comparison of means and then consider the intervals?
 
Last edited:
Physics news on Phys.org
The F-test doesn't really allow for finding out which coefficients are zero. It's a test for overall regression. To look at the main effects and see which are interesting and which are not, you'll have to do a multiple comparison test of some sort, depending on your goal. At the very least, you should probably apply Bonferroni correction (although that's a debatable path).
 
  • Like
Likes   Reactions: WWGD
I ( think I ) understand; the F-test only tells you ( If you reject ## H_0 ##) whether there is at least one non-zero coefficient in the regression ## Y=a_1X_1+..+a_n X_n ## , but does not say which. I understand afterwards you do pairwise comparisons.
 

Similar threads

  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 7 ·
Replies
7
Views
2K
  • · Replies 8 ·
Replies
8
Views
3K
  • · Replies 7 ·
Replies
7
Views
3K
Replies
26
Views
3K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 3 ·
Replies
3
Views
1K
  • · Replies 4 ·
Replies
4
Views
2K
  • · Replies 3 ·
Replies
3
Views
2K