How Do Linear Regression and R-Squared Differ?

Click For Summary

Discussion Overview

The discussion centers on the differences between linear regression and R-squared, exploring their relationship, applications, and potential pitfalls in analysis. It includes inquiries about examples, definitions, and the context in which these statistical tools are used.

Discussion Character

  • Exploratory
  • Technical explanation
  • Conceptual clarification

Main Points Raised

  • One participant seeks examples of linear regression and R-squared, questioning their relationship and usefulness to each other.
  • Another participant suggests using the term "coefficient of determination" instead of "R-squared," indicating a preference for precise terminology.
  • A participant explains that the "least squares line" represents the best fit for given data points, while R-squared quantifies the quality of that fit.
  • Further, a participant describes R-squared as a measure of linear correlation between two variables, noting its connection to the linear coefficient in simple linear regression.
  • Concerns are raised about the importance of contextualizing models, statistics, and data, emphasizing the need to understand limitations and shortcomings when interpreting results.
  • Applications of linear regression are mentioned, highlighting the variability in model specificity required for different fields, such as computer design versus ecological modeling.

Areas of Agreement / Disagreement

Participants express varying perspectives on the terminology and applications of linear regression and R-squared, with no consensus reached on their relationship or the best practices for analysis.

Contextual Notes

Limitations discussed include the need for contextual understanding of models and data, as well as the potential shortcomings of both linear regression and R-squared in different applications.

xeon123
Messages
90
Reaction score
0
I am trying to understand how linear regression and R-squared differ.

1 - Can anyone give me an example of use of linear regression and R-squared?

2 - They have some relation between them? E.g., they are useful for each other?

3 - What are the dangers when analysing the linear regression results?
 
Physics news on Phys.org
You should use the term "coefficient of determination" instead of "R-squared". Perhaps someone interested in that statistic will jump on your question.
 
The "least squares line" is the line that (in the "least squares" sense) best fits the given points. "R^2" is a numerical measure of just how good that fit is.
 
Hey xeon123.

1 - The measure looks at the level of linear correlation between two variables (assuming pair-wise relationships exist).

2 - There is a connection between this and the linear coefficient for a simple linear regression involving two variables (with an intercept and slope term), and you can find this by reading a decent book on the subject (i.e. linear regression).

3 - Just make sure you put the model, statistics, and data into context. Understand the models limitations, the limitations of the data, and the shortcomings of both when trying to answer the question you initially set out to.

Typically you are always trying to answer a question and you want to find an answer that is good enough to use for your application and simples enough to use and understand.

Applications vary quite a lot from say designing a computer to modelling fish harvest and birth processes. One application requires extremely specific models and the other just requires something that is "good enough".
 

Similar threads

  • · Replies 8 ·
Replies
8
Views
3K
  • · Replies 13 ·
Replies
13
Views
5K
Replies
3
Views
3K
  • · Replies 6 ·
Replies
6
Views
3K
  • · Replies 4 ·
Replies
4
Views
2K
  • · Replies 23 ·
Replies
23
Views
4K
  • · Replies 6 ·
Replies
6
Views
2K
  • · Replies 6 ·
Replies
6
Views
3K
  • · Replies 8 ·
Replies
8
Views
3K
  • · Replies 1 ·
Replies
1
Views
2K