Dismiss Notice
Join Physics Forums Today!
The friendliest, high quality science and math community on the planet! Everyone who loves science is here!

Question about Newton's method for solving a function

  1. Feb 7, 2012 #1
    Hi there,
    I am new to optimization theory. I just went thru solving linear equations using gradient descent. I am looking into Newton's method now which calculates second order derivatives. I was wondering if we really need the hessian matrix for this method to work. Can we just compute the diagonal elements in the hessian and not all elements in the hessian and approximate the Newton's method. I was wondering if anybody familiar with these methods could help me out.

  2. jcsd
  3. Feb 7, 2012 #2


    User Avatar
    Science Advisor
    Homework Helper

    You are right, you can work with approximations to the Hessian matrix. If you stick with your course (or textbook) a bit longer, you will probably soon find out about some of them.

    Methods using this idea are sometimes called quasi-Newton methods.
  4. Feb 8, 2012 #3
    Cool. That answers my question. Thanks!
Share this great discussion with others via Reddit, Google+, Twitter, or Facebook