Help with Interpreting Regression Results

  • Thread starter stunner5000pt
  • Start date
  • Tags
    Regression
In summary, the regression results show a multiple R value of 0.491468698, indicating a moderate positive correlation between the variables. The ANOVA results suggest that there is a significant relationship between the variables, with a p-value of 0.000215714. The regression line has a slope of -63.28227342 and an intercept of 2135.576773, both of which are statistically significant. However, the practical significance of the intercept may depend on the nature of the data and the relationship between the variables."
  • #1
stunner5000pt
1,461
2
Homework Statement
Determine if the intercept term is relevant
Relevant Equations
No equations, only interpretation
Hello all, need your help with interpreting regression reuslts

The results are given below for hte regression that I ran in Excel

Here, the dependant variable Pc is -63.28 with a standard error of 15.86.

But is this different from zero? I see the t-stat here is -3.99, and the p-value is 0.000215. In absolute value terms t > p, and thus Pc is different from zero.

But is this correct - should we use the absolute value of the t-stat? Or should we reject Pc since -3.99 < p value?

Summary Output
Regression Statistics
Multiple R
0.491468698​
R Square
0.241541481​
Adjusted R Square
0.226372311​
Standard Error
90.29795564​
Observations
52​
ANOVA
df
SS
MS
F
Significance F
Regression
1​
129833.1911​
129833.1911​
15.92318335​
0.000216​
Residual
50​
407686.0396​
8153.720793​
Total
51​
537519.2308​
Coefficients
Standard Error
t Stat
P-value
Lower 95%
Upper 95%
Lower 95.0%
Upper 95.0%
Intercept
2135.576773​
457.8577755​
4.6642798​
2.34319E-05​
1215.942​
3055.211​
1215.942​
3055.211​
Pc
-63.28227342​
15.85868325​
-3.990386366​
0.000215714​
-95.1354​
-31.4292​
-95.1354​
-31.4292​
 
Physics news on Phys.org
  • #2
I am not sure what you mean by being relevant , but the intercept is contained in the interval (1215.942,3055.211) with 95% confidence, so there is good reason to believe it is not 0, if that is what you mean.
 
  • #3
"In absolute value terms t > p, and thus Pc is different from zero."

You never compare a t-statistic (or the absolute value of a t-statistic, or ANY statistic) to a p-value. Very crudely stated, you make the decision to reject a null hypothesis if

* the test statistic is in some sense "big"
or
* the associated p-value is determined to be "small"

The rest of your question seems poorly worded.

* "Here, the dependant variable Pc is -63.28 with a standard error of 15.86." No, your dependent variable is not -63.28. From the output it appears that the SLOPE of your regression line is -63.28, The p-value would indicate that you can conclude it is "statistically significant". In the traditional (frequentist) hypothesis testing setting that information would mean you would conclude that "the population slope is non-zero". (Remember that you don't know the actual value of the population slope, since -63.28 is merely a point estimate.)
* The output shows the sample intercept is 2135.6 (approximately), and the p-value says you could conclude it is significant.REMEMBER that "significant" here means statistically significant, which essentially means that you're able to reject the null hypothesis that the true intercept is zero. Whether the intercept is significant in a practical setting -- that is, whether it tells you anything useful about the relationship between your y and Pc -- depends on whether Pc values are ever zero. If not (if they are restricted to be strictly positive or strictly negative) then the intercept doesn't provide any useful information about your relationship.
 

1. What is regression analysis and why is it important?

Regression analysis is a statistical method used to identify and quantify the relationship between a dependent variable and one or more independent variables. It is important because it allows us to understand the impact of independent variables on the dependent variable, make predictions, and identify any potential outliers or influential data points.

2. How do I interpret the coefficient values in a regression model?

The coefficient values in a regression model represent the estimated change in the dependent variable for every one unit change in the corresponding independent variable, holding all other variables constant. A positive coefficient indicates a positive relationship, while a negative coefficient indicates a negative relationship.

3. What is the difference between R-squared and adjusted R-squared?

R-squared is a measure of how well the regression model fits the data, with values ranging from 0 to 1. It represents the proportion of variation in the dependent variable that can be explained by the independent variables. Adjusted R-squared is a modified version of R-squared that takes into account the number of variables in the model, and provides a more accurate measure of model fit.

4. How do I determine the statistical significance of the regression model?

The statistical significance of a regression model can be determined by looking at the p-value. A p-value less than 0.05 indicates that the model is statistically significant, meaning that the independent variables have a significant impact on the dependent variable and the model is a good fit for the data.

5. How do I identify influential data points in a regression model?

Influential data points are those that have a significant impact on the regression model. They can be identified by looking at the Cook's distance or leverage values. Cook's distance measures the change in the regression coefficients when a particular data point is removed from the model, while leverage values measure how extreme the values of the independent variable are compared to the rest of the data. High values for either of these metrics indicate influential data points.

Similar threads

  • Set Theory, Logic, Probability, Statistics
Replies
1
Views
2K
  • Set Theory, Logic, Probability, Statistics
Replies
1
Views
1K
  • Poll
  • Science and Math Textbooks
Replies
1
Views
2K
  • Set Theory, Logic, Probability, Statistics
Replies
1
Views
9K
  • Special and General Relativity
Replies
5
Views
1K
  • Calculus and Beyond Homework Help
Replies
1
Views
959
Replies
4
Views
1K
  • Set Theory, Logic, Probability, Statistics
Replies
2
Views
7K
  • Programming and Computer Science
Replies
1
Views
2K
  • STEM Academic Advising
Replies
10
Views
4K
Back
Top