Dismiss Notice
Join Physics Forums Today!
The friendliest, high quality science and math community on the planet! Everyone who loves science is here!

Relationship between line search and least mean square algorithm

  1. Oct 8, 2012 #1
    Hi there,
    I am going thru basics of optimization and I see line search being used in many sophisticated optimization algorithms. From what I understand, it works by taking the derivative at a point and moves in a direction that minimizes the function. I have earlier experience using least mean square(LMS) algorithm which does a similiar thing and is widely used in linear regression and neural networks. I was wondering if LMS comes under the family of line search algorithms or there is a very fundamental difference I am missing.

  2. jcsd
Share this great discussion with others via Reddit, Google+, Twitter, or Facebook

Can you offer guidance or do you also need help?
Draft saved Draft deleted