Dismiss Notice
Join Physics Forums Today!
The friendliest, high quality science and math community on the planet! Everyone who loves science is here!

Neural networks and the derivatives of the cost function

  1. Jul 19, 2016 #1
    Hello. I need some guidance on the derivation of the derivatives of the quadratic cost function (CF) in an artificial neural network. I can derive the equations for the forward propagation with no trouble but when it comes to finding the derivative of the CF with respect to the weight matrix (matrices) I struggle to distinguish where to use the Hadamar product, where to use the dot matrix product and the order of the multiples. Does anyone know some good resources where I could see a thorough derivation of this OR linear algebra resource relevant to my question?
  2. jcsd
  3. Jul 20, 2016 #2
Share this great discussion with others via Reddit, Google+, Twitter, or Facebook

Have something to add?
Draft saved Draft deleted