-
Notifications
You must be signed in to change notification settings - Fork 272
Gershgorin Levenberg Marquardt regularization #1473
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
Should be renamed into |
I would stick to the naming. The "normal" Levenberg-Marquardt term with a fixed value is way more brutal compared to the Gershgorin approach 🛏️ 🌹 |
Considering a metaphoric level, the name sledgehammer gives a much deeper intuition than Levenberg-Marquardt, therefore, I would also consider renaming levenberg-marquardt to sledgehammer and keeping the gershgorin sledgehammer |
Implement new regularization module:
GERSHGORIN_LEVENBERG_MARQUARDT
.Estimates the smallest eigenvalue of each Hessian block using Gershgorin circles and adds multiple of identity to each block, such that smallest eigenvalue after regularization is at least
reg_epsilon
.