Testing regression model with F-test

Phoeniyx
Messages
16
Reaction score
1
Hey guys. I have some trouble understanding how the F-test is used for testing the viability of a regression model. Before I delve into the background/question, just wanted to post a link that discusses the topic briefly:
http://www.stat.yale.edu/Courses/1997-98/101/anovareg.htm

So, coming back to the question, let's say we have 77 data points (xi, yi) and we try to fit it to a regression model as:
\hat{y}_{i} = A + Bx_{i}

In the Yale example, A and B are calculated based on the 77 data points.

To check if the model is significant, we calculated the "explained sum of squares" (ESS) which is the squared difference between the model estimate and the mean: ESS = \Sigma{(\hat{y}_{i} - \bar{y})^{2}}

Then we calculate the "residual sum of squares" (RSS) which is the squared difference between the actual data point and the model: RSS = \Sigma{({y}_{i} - \hat{y}_{i})^{2}}

The degrees of freedom for RSS is: # of data points - estimated model parameters from data = 77 - 2 = 75. Perfectly fine with this.

BUT, apparently, the degrees of freedom for ESS is "1"... I do not get this. More on why I am confused later in the questions section.

The F-test value = \frac{ESS / DF_{ESS}}{RSS / DF_{RSS}}, where DF = degrees of freedom

In the Yale link above, this calculates to 8654.7/84.6 = 102.35

So, I have two questions:
1) Since the degrees of freedom of ESS is always "1", if I had 85 data points (instead of 77), the F-test value would be even larger - since ESS is not averaged and is simply the sum of squares between model value and mean. e.g. the 8654.7 above could be 9500 and the 84.6 (RSS/DF) above could be higher or lower - but will likely be still around 85 (larger sum of squares / 85). Wouldn't this imply that the significance is a function of the # of data points tested on the model (as opposed to real-world observed data points)? Related to this question, does the # of (x, y) real-world observed points used for RSS calculation (e.g. 77) must be the same as the # of points for the ESS calculation? e.g. can ESS be based on 95 model trials while RSS is only based on the 77 real world values?

2) I still don't understand (conceptually) why the F-test works to check whether the model parameters A and B are zero or not. Conceptually, how does this make sense?

Thanks very much everyone.
 
Physics news on Phys.org
Using the formulas for A and B, ESS is proportional to the variance of B, i.e. the variance of 1 degree of freedom.
 
Hi DrDu. I am sorry, but I am not understanding your response. Could you please elaborate a bit further? Thank you.
 
Namaste & G'day Postulate: A strongly-knit team wins on average over a less knit one Fundamentals: - Two teams face off with 4 players each - A polo team consists of players that each have assigned to them a measure of their ability (called a "Handicap" - 10 is highest, -2 lowest) I attempted to measure close-knitness of a team in terms of standard deviation (SD) of handicaps of the players. Failure: It turns out that, more often than, a team with a higher SD wins. In my language, that...
Hi all, I've been a roulette player for more than 10 years (although I took time off here and there) and it's only now that I'm trying to understand the physics of the game. Basically my strategy in roulette is to divide the wheel roughly into two halves (let's call them A and B). My theory is that in roulette there will invariably be variance. In other words, if A comes up 5 times in a row, B will be due to come up soon. However I have been proven wrong many times, and I have seen some...

Similar threads

Replies
30
Views
4K
Replies
5
Views
2K
Replies
4
Views
2K
Replies
5
Views
2K
Back
Top