How should a physicist learn Machine Learning?

Click For Summary

Discussion Overview

The discussion revolves around how a physicist, particularly a master's student, should approach learning machine learning (ML) and neural networks. It covers resources, foundational knowledge, and the relationship between traditional statistical methods and deep learning.

Discussion Character

  • Exploratory
  • Technical explanation
  • Conceptual clarification
  • Homework-related

Main Points Raised

  • One participant expresses a desire to understand neural networks better while working on their thesis and seeks recommendations for accessible resources.
  • Another participant recommends a quick introduction resource, suggesting it could help develop intuition for neural networks.
  • A third participant highlights a video series by 3Blue1Brown as an excellent explanation of neural networks.
  • Some participants outline that deep learning is fundamentally about curve fitting or classification, with neural networks parameterizing complex functions.
  • Concerns are raised about the number of parameters in neural networks compared to data points and the challenges of overfitting, which is not fully understood.
  • There is a suggestion that multiple methods could achieve similar curve fits, indicating that understanding the underlying methods may not be essential for practical application.
  • One participant emphasizes that while deep learning can be seen as ordinary in terms of curve fitting, it possesses surprising and powerful capabilities.

Areas of Agreement / Disagreement

Participants generally agree on the foundational concepts of machine learning and the importance of understanding neural networks, but there are varying opinions on the necessity of deep understanding versus practical application. The discussion remains unresolved regarding the best approach to learning and the depth of knowledge required.

Contextual Notes

Participants express limitations in their backgrounds and the challenge of finding appropriate resources that balance depth and accessibility. There is also mention of unresolved aspects of error estimation in deep learning.

Phylosopher
Messages
139
Reaction score
26
TL;DR
Doing my master thesis in physics using machine learning (geared toward physics not machine learning). I can not afford learning neural networks "the regular way" because lack of time. What should I start with?
Hello everyone,
I am currently a master student working on physics and neural networks. I have already started producing neural network results (I use tensorflow and keras) so I know how to program the basic things that I am required to do, the problem is that I do not understand them well.

I do not have a good solid background when it comes to the neural networks themselves, and as a master student working on his thesis, I can not/I do not want to write my thesis blindly. I want to truly understand the behavior of my program.

Problem is, I can not afford reading a 600 page book on ML! My idea was to read the papers that are mentioned in the tensorflow pages once I use a specific function or class(Example: Here). But as I said, I do not have a solid background to read them properly.
So, my question is, what resources you think I should read first before I delve deeper in these papers? I need the bare minimum so I can accelerate my learning.

Things I have bookmarked so far that I think are useful:: Quick hand on introduction, Intro book, More detailed Intro book ... Do you think these are good starting points? Do you have better suggestions?
 
Technology news on Phys.org
Quick hand on introduction - I can thoroughly recommend this, it should help you develop a deep intuition for the process and could be all you need.

Intro book - I'm not familiar with this but looking at the ToC it might be a good fit.

More detailed Intro book - this seems to have a much wider scope than you need but might be good context.
 
  • Like
Likes   Reactions: FactChecker, jedishrfu and atyy
This short, four video set is the best explanation of neural networks that I've seen in my three years of study - 3Blue1Brown Neural Networks.
 
  • Like
Likes   Reactions: jedishrfu, Greg Bernhardt, nsaspook and 3 others
The minimum ideas of machine learning are that deep learning is essentially curve fitting or classification. A neural network simply parameterizes a very complicated function. A traditional algorithm for curve fitting is linear regression. A traditional algorithm for classification is logistic regression.

Compared to basic statistical methods, an odd thing about neural networks is that there are many more parameters than data points. There are tricks that prevent overfitting. However, why overfitting can be avoided is not yet well understood.

Also, methods of estimating errors in deep learning are not well understood. However, there are reasonable attempts.
 
  • Like
Likes   Reactions: Borg and Greg Bernhardt
atyy said:
The minimum ideas of machine learning are that deep learning is essentially curve fitting or classification
That is the essential lesson. It is possible that more than one method could lead to the same or a very similar curve fit. It's possible even if those other methods are not similar to deep learning.

So if you are just using the fit, or just using a tool to create the fit, it is not essential to learn the methods used.
 
atyy said:
The minimum ideas of machine learning are that deep learning is essentially curve fitting or classification. A neural network simply parameterizes a very complicated function. A traditional algorithm for curve fitting is linear regression. A traditional algorithm for classification is logistic regression.
Although I wouldn't want to make deep learning sound too ordinary. Even for someone very used to curve fitting, there are many aspects and capabilities of deep learning that are surprising, powerful, and fascinating.
 
  • Like
Likes   Reactions: pbuk

Similar threads

  • · Replies 13 ·
Replies
13
Views
3K
  • · Replies 4 ·
Replies
4
Views
3K
Replies
6
Views
1K
  • · Replies 1 ·
Replies
1
Views
3K
  • · Replies 4 ·
Replies
4
Views
3K
  • · Replies 5 ·
Replies
5
Views
2K
  • · Replies 102 ·
4
Replies
102
Views
3K
  • · Replies 10 ·
Replies
10
Views
3K
  • · Replies 6 ·
Replies
6
Views
2K
  • · Replies 43 ·
2
Replies
43
Views
7K