Solving Optimization Problems: Avoiding Local Minima

  • Thread starter Thread starter ggyyree
  • Start date Start date
  • Tags Tags
    Optimization
ggyyree
Messages
2
Reaction score
0
I met a problem about finding the optimization of some function. I used the Trust-Region Newton and Quasi-Newton methods for the problem; however, with different initial guesses I sometimes got the local minimums. May I ask how to get out the trap of the local minimums please?

I may try the Radom Walk method but it seems not be a good one. Any other ideas please reply! Thanks a lot!
 
Mathematics news on Phys.org
Simulated annealing is a method which is designed to overcome being trapped in local minima.
Section 10.9 of this book describes the method:
http://www.fizyka.umk.pl/nrbook/bookcpdf.html
 
Last edited by a moderator:

Thread 'What Exactly is Dirac’s Delta Function? - Insight'

Insights auto threads is broken atm, so I'm manually creating these for new Insight articles. In Dirac’s Principles of Quantum Mechanics published in 1930 he introduced a “convenient notation” he referred to as a “delta function” which he treated as a continuum analog to the discrete Kronecker delta. The Kronecker delta is simply the indexed components of the identity operator in matrix algebra Source: https://www.physicsforums.com/insights/what-exactly-is-diracs-delta-function/ by...
View full post »

Thread 'Fermat's Last Theorem'

Fermat's Last Theorem has long been one of the most famous mathematical problems, and is now one of the most famous theorems. It simply states that the equation $$ a^n+b^n=c^n $$ has no solutions with positive integers if ##n>2.## It was named after Pierre de Fermat (1607-1665). The problem itself stems from the book Arithmetica by Diophantus of Alexandria. It gained popularity because Fermat noted in his copy "Cubum autem in duos cubos, aut quadratoquadratum in duos quadratoquadratos, et...
View full post »
Thread 'Imaginary Pythagorus'

Thread 'Imaginary Pythagorus'

I posted this in the Lame Math thread, but it's got me thinking. Is there any validity to this? Or is it really just a mathematical trick? Naively, I see that i2 + plus 12 does equal zero2. But does this have a meaning? I know one can treat the imaginary number line as just another axis like the reals, but does that mean this does represent a triangle in the complex plane with a hypotenuse of length zero? Ibix offered a rendering of the diagram using what I assume is matrix* notation...
View full post »

Similar threads

A Finding Global Minima in Likelihood Functions
Replies
1
Views
2K
I Gradient descent algorithm and optimizers
Replies
5
Views
2K
I Optimization problem with multiple outputs: impossible?
Replies
6
Views
2K
I Multivariable optimization problem
Replies
6
Views
2K
Solving Optimization Problem: Local Minima Traps & Solutions
Replies
1
Views
2K
Can I Optimize X for a Given Level Curve with Partial Derivatives?
Replies
2
Views
2K
Multi Variable Optimization Problem
Replies
2
Views
2K
MHB Solving Equations Using Bisection, Newton, and Secant Methods
Replies
8
Views
3K
I Optimization problem: Error mitigation while using trigonometry
Replies
18
Views
2K
Generalized optimization under uncertainty problem
Replies
6
Views
3K

Hot Threads

Recent Insights

Back
Top