Least squares parameter correlation

Click For Summary
SUMMARY

The discussion centers on addressing high parameter correlation in least squares inversion, specifically when modeling multiple sources. The user has attempted Tikhonov regularization without success, highlighting its common use for ill-posed problems and the challenge of selecting an appropriate regularization parameter, α. The conversation suggests exploring L curves and S curves as potential techniques for reducing parameter correlation in least squares systems.

PREREQUISITES
  • Understanding of least squares inversion techniques
  • Familiarity with Tikhonov regularization methods
  • Knowledge of residual norm calculations
  • Basic concepts of parameter correlation in statistical modeling
NEXT STEPS
  • Research L curves and their application in regularization techniques
  • Explore S curves and their definitions in the context of parameter correlation
  • Investigate alternative regularization methods beyond Tikhonov
  • Learn about advanced techniques for parameter decoupling in least squares problems
USEFUL FOR

Researchers, data scientists, and statisticians working on least squares inversion problems, particularly those dealing with parameter correlation in modeling scenarios.

vibe3
Messages
39
Reaction score
1
I am trying to solve a large least squares inversion (inverting data for the modeled sources), and find that my parameters describing 1 source are highly correlated with the parameters describing the second source.

Can anyone recommend a technique or reference which discusses how to reduce the correlation between parameters in a least squares system? I have already tried Tikhonov regularization (damping each set of parameters) with no luck.
 
Physics news on Phys.org
I used Thikonov in my MSc thesis, and it is a genera method used on ill - posed problems, and it works fine. What you usually find is some correlation between a set of data (the one you one to calculate) with some "noise" of this data. Thikonov used the parameter \alpha to regularize the solution. You may calculate the residual norm (RN) between your desired data and the one you obtain. However, using Thikonov regularization means to include this regulator \alpha |S|^{2} in the residual norm and minimize it, where S is the solution. The problem with this method is a non- well stablished criterion to find the appropiate value of the parameter.

I suggest you to take a look at the L curves and S curves an its definitions,I hope I gave you a taste about it.
 

Similar threads

  • · Replies 2 ·
Replies
2
Views
2K
Replies
6
Views
1K
  • · Replies 4 ·
Replies
4
Views
3K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 6 ·
Replies
6
Views
3K
  • · Replies 9 ·
Replies
9
Views
2K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 54 ·
2
Replies
54
Views
6K
  • · Replies 13 ·
Replies
13
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K