How Does Linear Regression Differ Between Statistics and Machine Learning?

Click For Summary

Discussion Overview

The discussion revolves around the differences between linear regression in statistics and machine learning, focusing on predictive power and interpretability. Participants explore how these two fields approach linear regression, particularly in terms of methodology and application.

Discussion Character

  • Debate/contested
  • Conceptual clarification

Main Points Raised

  • Some participants question whether there is a sharp difference in predictive power between machine learning and statistics.
  • There is a suggestion that both fields use similar algorithms, such as linear regression, for making predictions.
  • One participant notes that machine learning often employs neural networks, which can fit data more flexibly but may place less emphasis on statistical confidence.
  • Another participant expresses disagreement with a previous summary of the differences, indicating that linear regression itself remains consistent across both fields.
  • There is a mention of the broader range of techniques included in machine learning compared to traditional statistics, which may influence perceptions and compensation in the field.

Areas of Agreement / Disagreement

Participants express differing views on the summary of differences between linear regression in statistics and machine learning, indicating that the discussion remains unresolved with multiple competing perspectives.

Contextual Notes

Participants highlight the potential for misunderstanding regarding the scope of machine learning techniques beyond linear regression, suggesting that assumptions about the fields may vary.

fog37
Messages
1,566
Reaction score
108
Hello,

I am trying to wrap my head around the difference between machine learning and statistics for predictive purposes and interpretability...

Is there a sharp difference between the two in terms of predictive power? I understand how machine learning needs to be first trained with data to later make useful predictions, etc. Some of the used algorithms are the same we find in statistics (for ex., linear regression).

Given a set of data (not extremely larger), how is linear regression done with machine learning different from the more traditional linear regression?
 
  • Like
Likes   Reactions: WWGD
Technology news on Phys.org
More specifically, how is linear regression done in statistics different from linear regression done with machine learning? Both seem identical processes to predict data we don't have from data we have...
 
Machine learning sells better than statistics.
 
  • Like
Likes   Reactions: phinds
I see...thanks.
 
A lot of machine learning algorithms use neural networks. Neural networks often use functions that are highly nonlinear but allow a better fit to the "training data". There tends to be less emphasis on the statistical confidence of the results. The subject of neural networks is important to understand if you wish to work in machine learning. There is a wide variety of applications, from simply fitting data to having the network develop its own patterns and classifications.
 
  • Like
Likes   Reactions: olgerm
DrStupid said:
Machine learning sells better than statistics.
I disagree with this as a summary of the differences.
 
Last edited:
FactChecker said:
I disagree with this as a summary of the differences.

"How is linear regression done in statistics different from linear regression done with machine learning" in your opinon?
 
  • Like
Likes   Reactions: FactChecker
DrStupid said:
"How is linear regression done in statistics different from linear regression done with machine learning" in your opinon?
Oh, I stand corrected on that part. Linear regression is linear regression. But machine learning and artificial intelligence include so many other techniques that I think it is good to correct the misguided impression of the OP. That may be a reason for a different pay scale.
 

Similar threads

  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 13 ·
Replies
13
Views
3K
  • · Replies 6 ·
Replies
6
Views
3K
  • · Replies 29 ·
Replies
29
Views
3K
Replies
63
Views
11K
  • · Replies 8 ·
Replies
8
Views
3K
  • · Replies 133 ·
5
Replies
133
Views
12K
Replies
3
Views
3K
  • · Replies 29 ·
Replies
29
Views
4K
  • · Replies 28 ·
Replies
28
Views
3K