A Solving analytic gradient for multilayer perceptron loss function

AI Thread Summary
The discussion focuses on the challenge of solving the analytic gradient for the loss function in multilayer perceptrons, emphasizing the need for a strong theoretical background to address the question effectively. Participants note that without further context or explanation, finding knowledgeable contributors may be difficult. A reference to the scikit-learn documentation is provided for those seeking additional information on neural networks. The conversation highlights the complexity of the topic and the specialized knowledge required. Overall, expertise in theoretical concepts is crucial for tackling this specific problem in machine learning.
AlanTuring
Messages
6
Reaction score
0
TL;DR Summary
Theoretical question concerning the solving of analytic gradient for multilayer perceptron loss function
244469
 
Mathematics news on Phys.org

Thread 'What Exactly is Dirac’s Delta Function? - Insight'

Insights auto threads is broken atm, so I'm manually creating these for new Insight articles. In Dirac’s Principles of Quantum Mechanics published in 1930 he introduced a “convenient notation” he referred to as a “delta function” which he treated as a continuum analog to the discrete Kronecker delta. The Kronecker delta is simply the indexed components of the identity operator in matrix algebra Source: https://www.physicsforums.com/insights/what-exactly-is-diracs-delta-function/ by...
View full post »

Thread 'Non-orthogonal bases'

Suppose ,instead of the usual x,y coordinate system with an I basis vector along the x -axis and a corresponding j basis vector along the y-axis we instead have a different pair of basis vectors ,call them e and f along their respective axes. I have seen that this is an important subject in maths My question is what physical applications does such a model apply to? I am asking here because I have devoted quite a lot of time in the past to understanding convectors and the dual...
View full post »
Thread 'Imaginary Pythagoras'

Thread 'Imaginary Pythagoras'

I posted this in the Lame Math thread, but it's got me thinking. Is there any validity to this? Or is it really just a mathematical trick? Naively, I see that i2 + plus 12 does equal zero2. But does this have a meaning? I know one can treat the imaginary number line as just another axis like the reals, but does that mean this does represent a triangle in the complex plane with a hypotenuse of length zero? Ibix offered a rendering of the diagram using what I assume is matrix* notation...
View full post »

Similar threads

I Gradient descent algorithm and optimizers
Replies
5
Views
2K
Why is my multilayered, feedforward neural network not working?
2
Replies
50
Views
4K
Mathematica Neural networks in Wolfram Mathematica
Replies
1
Views
3K
Newbie question about deep learning
Replies
1
Views
2K
Normalization condition with a neural network
Replies
3
Views
1K
B Are Inverse Problems More Complex Than Direct Problems in Mathematics?
Replies
13
Views
3K
Multilayer perceptron questions
Replies
1
Views
1K
I What Is the Difference Between Loss and Cost Functions in Quantum Computing?
Replies
3
Views
1K
Neural network without neurotransmitters
Replies
26
Views
3K
Neural networks as mathematical models of intelligence
Replies
4
Views
2K

Hot Threads

Recent Insights

Back
Top