Hi there,(adsbygoogle = window.adsbygoogle || []).push({});

I am going thru basics of optimization and I see line search being used in many sophisticated optimization algorithms. From what I understand, it works by taking the derivative at a point and moves in a direction that minimizes the function. I have earlier experience using least mean square(LMS) algorithm which does a similiar thing and is widely used in linear regression and neural networks. I was wondering if LMS comes under the family of line search algorithms or there is a very fundamental difference I am missing.

thanks!

**Physics Forums | Science Articles, Homework Help, Discussion**

Join Physics Forums Today!

The friendliest, high quality science and math community on the planet! Everyone who loves science is here!

The friendliest, high quality science and math community on the planet! Everyone who loves science is here!

# Relationship between line search and least mean square algorithm

Can you offer guidance or do you also need help?

Draft saved
Draft deleted

**Physics Forums | Science Articles, Homework Help, Discussion**