• Support PF! Buy your school textbooks, materials and every day products Here!

Learning the non-physics part of Statistical Mechanics

  • #1

Main Question or Discussion Point

Hello, this is my first question on PhysicsForum. I am primarily interested in statistics/machine learning. I have recently discovered that many of the ideas used in machine learning came from statistical physics/ statistical mechanics.

I am just wondering if it's a bad idea to attempt to learn the computational/mathematical aspects of statistical mechanics with zero physics background? Maybe it's easier to learn some physics before attempting this?
 

Answers and Replies

  • #2
FactChecker
Science Advisor
Gold Member
5,538
2,030
I associate machine learning with neural networks, pattern recognition, etc. Can you be more specific about how machine learning is related to statistical physics/ statistical mechanics?
 
  • #3
Here are some examples:

"According to Watkin et al. (1993), statistical physics tools are not only well suited to analyze existing learning algorithms but also they may suggest new approaches. In the paradigm of learning from examples (the paradigm considered in this book), examples are drawn from some unknown but fixed probability distribution and, once chosen, constitute a static quenched disorder (Watkin et al., 1993)."

"Statistical Physics and Representations in Real and Artificial Neural Networks" https://arxiv.org/abs/1709.02470

https://arxiv.org/pdf/1706.09779.pdf Ising Models and Spin Glass Models are used in machine learning.
 
  • Like
Likes FactChecker
  • #4
FactChecker
Science Advisor
Gold Member
5,538
2,030
I can't tell if these are applications of statistical mechanics in the field of neural networks or the reverse -- applications of deep neural networks in the field of statistical mechanics. It looks more like the latter to me, which I could imagine and Google shows several articles along those lines.

If it is true that they are applications of deep neural networks in the field of statistical mechanics, then you may be making a mistake in trying study statistical mechanics to help you understand machine learning.
 
  • #5
No one can learn statistical mechanics without a proper physics background. Besides, the amount of machine learning in a typical statistical mechanics introductory course is close to zero.
If you are interested in machine learning, you should learn machine learning.
 
  • #6
boneh3ad
Science Advisor
Insights Author
Gold Member
3,088
758
Isn't the non-physics part of statistical mechanics just... statistics?
 
  • Like
Likes vanhees71
  • #7
gleem
Science Advisor
Education Advisor
1,612
981
  • #8
gleem
Science Advisor
Education Advisor
1,612
981
  • #9
Stephen Tashi
Science Advisor
7,118
1,300
Isn't the non-physics part of statistical mechanics just... statistics?
If you find a text where it is, I'd like to know about it. Random variables "sample spaces" (or "probability spaces"), estimators, probability models - all familiar things when problems are presented in the context of statistics don't appear in the expositions of statistical physics that I've seen. There is traditional terminology in statistical physics that predates (and overcomes) the terminology of modern probability theory and statistics.
 

Related Threads on Learning the non-physics part of Statistical Mechanics

Replies
2
Views
4K
Replies
4
Views
1K
  • Last Post
Replies
7
Views
3K
Replies
4
Views
1K
  • Last Post
Replies
4
Views
2K
Replies
3
Views
2K
  • Last Post
Replies
6
Views
2K
Replies
4
Views
677
  • Last Post
Replies
2
Views
7K
Replies
3
Views
969
Top