Hi there, I am going thru basics of optimization and I see line search being used in many sophisticated optimization algorithms. From what I understand, it works by taking the derivative at a point and moves in a direction that minimizes the function. I have earlier experience using least mean square(LMS) algorithm which does a similiar thing and is widely used in linear regression and neural networks. I was wondering if LMS comes under the family of line search algorithms or there is a very fundamental difference I am missing. thanks!