Hello. I need some guidance on the derivation of the derivatives of the quadratic cost function (CF) in an artificial neural network. I can derive the equations for the forward propagation with no trouble but when it comes to finding the derivative of the CF with respect to the weight matrix (matrices) I struggle to distinguish where to use the Hadamar product, where to use the dot matrix product and the order of the multiples. Does anyone know some good resources where I could see a thorough derivation of this OR linear algebra resource relevant to my question?(adsbygoogle = window.adsbygoogle || []).push({});

**Physics Forums - The Fusion of Science and Community**

The friendliest, high quality science and math community on the planet! Everyone who loves science is here!

# Neural networks and the derivatives of the cost function

Have something to add?

Draft saved
Draft deleted

Loading...

Similar Threads - Neural networks derivatives | Date |
---|---|

Has anyone tried to train a neural network to learn physics? | Jan 12, 2018 |

Python Neural Network training BUT testing fails | Dec 2, 2017 |

Conditional Digital Feedback; is it a good Idea? (Neural Networks) | Oct 11, 2017 |

Convolution Neural Network | Nov 21, 2016 |

Neural networks and music | Apr 22, 2016 |

**Physics Forums - The Fusion of Science and Community**