MHB F-Test : Do we accept the null-hypothesis?

  • Thread starter Thread starter mathmari
  • Start date Start date
mathmari
Gold Member
MHB
Messages
4,984
Reaction score
7
Hey! :o

The below table shows the average monthly gross income of a sample of 44 developers. For each individual sample, it is indicated their country of employment and years of service in their field.

Calculate the regression line with the dependent variable the monthly gross income and independent the years of employee service and check the significance of the F criterion at $\alpha = 0.05$. I have done the following:

View attachment 9503

Therefore we get:
\begin{align*}\nu &=44 \\ \overline{X}&=\frac{\sum X}{\nu}=\frac{426.1}{44}=9.68 \\ \overline{Y}&=\frac{\sum Y}{\nu}=\frac{299767.60}{44}=6812.9 \\ \hat{\beta}&=\frac{\nu \sum \left (XY\right )-\left (\sum X\right )\left (\sum Y\right )}{\nu\sum X^2-\left (\sum X\right )^2}=\frac{44 \cdot 2911490.795-426.1\cdot 299767.60}{44\cdot 4417.39-426.1^2}=\frac{1.2810559498 \cdot 10^8-1.2773097436 \cdot 10^8}{194365.16-181561.21} \\ & =\frac{374620.62}{12803.95}=29.26 \\ \hat{\alpha}&=\overline{Y}-\hat{\beta}\cdot \overline{X}=6812.9-29.26\cdot 9.68=6812.9-283.2368=6529.66\end{align*}

So the regression line is \begin{equation*}\hat{Y}=29.26X+6529.66\end{equation*} We consider a F-test whether the slope is $0$ or not.

We have the formula $\displaystyle{F=\frac{MSM}{MSE}=\frac{\text{explained variance}}{\text{unexplained variance}}}$.

We have that $\displaystyle{MSM = \frac{SSM}{DFM}}$ with $\displaystyle{SSM=\sum_{i=1}^n\left (\hat{Y}_i-\overline{Y}\right )^2}$ and $\displaystyle{DFM = p - 1}$.

We also have that $\displaystyle{MSE = \frac{SSE}{DFE}}$ with $\displaystyle{SSE=\sum_{i=1}^n\left (Y_i-\hat{Y}_i\right )^2}$ and $\displaystyle{DFE = \nu-p}$. We have this table.

So we get
\begin{align*}&SSM=249138.5759 \\ &DFM=2-1=1 \\ &SSE=104926827.5 \\ &DFE=44-2=42 \\ &MSM=\frac{SSM}{DFM}=\frac{249138.5759}{1}=249138.5759 \\ &MSE=\frac{SSE}{DFE}=\frac{104926827.5}{42}=2498257.7976 \\ &F=\frac{MSM}{MSE}=\frac{249138.5759}{2498257.7976}=0.0997\end{align*}

Using at the R-program the command pf(0.0997, 1, 42, lower.tail=F) we get the p-value $0.7537537$.

That means that $\text{p-value} > \alpha$, does this mean that we accept the null hypothesis, i.e. that the slope is not significally different from $0$.

Is that correct? (Wondering)
 

Attachments

  • Y_X.JPG
    Y_X.JPG
    96.4 KB · Views: 119
Physics news on Phys.org
mathmari said:
That means that $\text{p-value} > \alpha$, does this mean that we accept the null hypothesis, i.e. that the slope is not significally different from $0$.

Is that correct?

Hey mathmari!

Formally it means we do not have sufficient evidence to conclude the slope is different from 0.
We 'keep' the null hypothesis, but we cannot conclude that the slope is 0. (Nerd)
 
Klaas van Aarsen said:
Formally it means we do not have sufficient evidence to conclude the slope is different from 0.
We 'keep' the null hypothesis, but we cannot conclude that the slope is 0. (Nerd)

Ah ok! Is there a way to check if my results are correct? (Wondering)
 
mathmari said:
Ah ok! Is there a way to check if my results are correct?

Excel has the [M]LINEST[/M] function.
One of its outputs is the F-value when used in a 5x2 array context for a simple linear regression. (Thinking)
Excel also has the [M]F.DIST[/M] function to convert an F-value into a probability.

We can also do a t-test for the slope as we did before. It should yield the same p-value. (Thinking)

Additionally we can draw a graph of the points and the line to see if it makes sense that the explained variance is so much lower than the unexplained variance. (Thinking)
 
Klaas van Aarsen said:
Excel has the [M]LINEST[/M] function.
One of its outputs is the F-value when used in a 5x2 array context for a simple linear regression. (Thinking)

Using the command [M]LINEST(D2:D45;B2:B45)[/M] I get $29.25833947$. If I used the command correctly, I must have a mistake at the calculations of $F$. But what? (Wondering)
 
mathmari said:
Using the command [M]LINEST(D2:D45;B2:B45)[/M] I get $29.25833947$. If I used the command correctly, I must have a mistake at the calculations of $F$. But what? (Wondering)

To get the F-value from LINEST, we need to specify 4 parameters. And we must make it an array formula with Ctrl+Shift+Enter. (Thinking)

You should also get for instance the slope and the y intercept. Do they match? (Wondering)
 
Hi all, I've been a roulette player for more than 10 years (although I took time off here and there) and it's only now that I'm trying to understand the physics of the game. Basically my strategy in roulette is to divide the wheel roughly into two halves (let's call them A and B). My theory is that in roulette there will invariably be variance. In other words, if A comes up 5 times in a row, B will be due to come up soon. However I have been proven wrong many times, and I have seen some...
Thread 'Detail of Diagonalization Lemma'
The following is more or less taken from page 6 of C. Smorynski's "Self-Reference and Modal Logic". (Springer, 1985) (I couldn't get raised brackets to indicate codification (Gödel numbering), so I use a box. The overline is assigning a name. The detail I would like clarification on is in the second step in the last line, where we have an m-overlined, and we substitute the expression for m. Are we saying that the name of a coded term is the same as the coded term? Thanks in advance.
Back
Top