Why Does the Levenberg-Marquardt Algorithm Focus on Minimizing Functions?

  • Context: Undergrad 
  • Thread starter Thread starter yellowputty
  • Start date Start date
  • Tags Tags
    Algorithm
Join the discussion
Ask a follow-up here, or get your own question answered by working scientists, mathematicians and engineers — people, not an autocomplete.
Real named experts · corrections over time · the nuance an AI answer skips
1 reply · 3K views
yellowputty
Messages
8
Reaction score
0
Hello Physics Forums,

In my project work, I've had to use the LMA technique for some non linear fitting. I really want to understand what it's doing rather than just using it. I have a poor knowledge of non linear fitting so please bear with me!

When producing the line of best fit, it needs to follow the data points extremely closely, obviously. To do this it minimises the sum of the square of the residuals, correct? So when I'm reading this literature, why does it always talk about minimising the function? I understand the LMA is only able to find a local minimum and not a global one, and hence it's important to set sensible initial starting parameters.

But why does the method need to find the minimum? Is it that a local minimum that might not be the global minimum trick it into thinking it found it, and send the curve off in the wrong direction? (In my head I have the idea of an x^3 trend with an x^2 fit if that makes any sense).

When the literature is talking about minimisation, what is it referring to? The residuals or the curve itself?

Also, for bonus points, could anyone explain what a trust region is in simple terms?

Any insight at all would be greatly appreciated!

Thank you in advance.
 
Physics news on Phys.org