Neural networks and the derivatives of the cost function

AI Thread Summary
The discussion centers on the challenges of deriving the derivatives of the quadratic cost function in artificial neural networks, particularly in relation to the weight matrices. The user expresses difficulty in determining when to apply the Hadamard product versus the dot product, as well as the correct order of operations in matrix multiplication. A suggestion is made to refer to a derivation found on stats.stackexchange, which emphasizes the importance of the chain rule for derivatives in this context. The conversation highlights the need for clear resources that explain these mathematical concepts in relation to neural networks.
2sin54
Messages
109
Reaction score
1
Hello. I need some guidance on the derivation of the derivatives of the quadratic cost function (CF) in an artificial neural network. I can derive the equations for the forward propagation with no trouble but when it comes to finding the derivative of the CF with respect to the weight matrix (matrices) I struggle to distinguish where to use the Hadamar product, where to use the dot matrix product and the order of the multiples. Does anyone know some good resources where I could see a thorough derivation of this OR linear algebra resource relevant to my question?
 
Technology news on Phys.org
Thread 'Is this public key encryption?'
I've tried to intuit public key encryption but never quite managed. But this seems to wrap it up in a bow. This seems to be a very elegant way of transmitting a message publicly that only the sender and receiver can decipher. Is this how PKE works? No, it cant be. In the above case, the requester knows the target's "secret" key - because they have his ID, and therefore knows his birthdate.
I tried a web search "the loss of programming ", and found an article saying that all aspects of writing, developing, and testing software programs will one day all be handled through artificial intelligence. One must wonder then, who is responsible. WHO is responsible for any problems, bugs, deficiencies, or whatever malfunctions which the programs make their users endure? Things may work wrong however the "wrong" happens. AI needs to fix the problems for the users. Any way to...
Back
Top