Applied Maths of Neural Networks -- books and papers?

Click For Summary
The discussion centers on the search for up-to-date books and research papers focused on the mathematics of neural networks, specifically seeking generalized theorems related to optimizing neuron placement and weight calculations. A user mentions having read "Intro to the Theory of Neural Computation" by John Hertz but finds it outdated. They express interest in rigorous texts that include proofs, particularly those that delve into geometry and differential equations, including fractional applications. Recommendations include "Hands-on Machine Learning with Scikit-Learn, Keras, and TensorFlow," which, while practical, may lack detailed mathematical rigor, and "Algorithms for Optimization," noted for its coverage of machine learning algorithms and written in Julia. The conversation highlights a desire for resources that balance theoretical depth with practical application in neural network optimization.
s00mb
Messages
33
Reaction score
10
Does anyone know any good up to date books on the mathematics of neural networks? If you know any good research papers that would be cool too. I've read through "Intro to the theory of neural computation" by John Hertz but it's a 1991 book. I'm looking for generalized theorems on optimizing/minimizing the placement and number of neurons in the network assuming some given way of calculating the weights. Also, if you know any cool research papers I'd like to know them. I've already seen the one on changing one pixel input to confuse a NN though. Geometry and Differential Equations (especially fractional applications) a plus. I've been browsing the internet for it and figured I'd try to pick your brains for it while I am at it. Thanks in advance.
 
Physics news on Phys.org
There's a lot of books out there. The one I like is:

Hands-on Machine Learning with Scikit-Learn, Keras and Tensorflow

It likely has some interesting math in it although most books skip past the details and go for the practice more. People want to use the algorithms to do cool stuff and leave the math to the developers of these packages.

Another book of interest would be:

Algorithms for Optimization

which covers many of the algorithms used in machine learning. All the code is written in Julia.
 
Yeah, I've read through most of the "practical" books, I was looking for rigorous books with proofs. Ohhh bonus points for using Julia I like that I'll have to check it out just for that :)
 
Last edited:
Many years ago, as the internet was coming of age, I burned over 500 pounds of technical manuals. I realized I can look things up on the internet faster than I can find something in a technical manual. And just about anything I might need could be found online. But letting go of my several shelves worth of college text and other science books is another matter. I can't bring myself to get rid of them but there is very little if anything I can't find online now. Books are heavy and a pain...
This thread only works as a summary from the original source: List of STEM Masterworks in Physics, Mechanics, Electrodynamics... The original thread got very long and somewhat hard to read so I have compiled the recommendations from that thread in an online (Google Drive) spreadsheet. SUMMARY Permits are granted so you can make comments on the spreadsheet but I'll initially be the only one capable of edition. This is to avoid the possibility of someone deleting everything either by mistake...

Similar threads