Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement any initial approaching using a Newtons method #27

Open
andcastillo opened this issue Apr 8, 2019 · 2 comments
Open

Implement any initial approaching using a Newtons method #27

andcastillo opened this issue Apr 8, 2019 · 2 comments

Comments

@andcastillo
Copy link

andcastillo commented Apr 8, 2019

We should implement a globalization part. It could put the method close enough to the optimum before starting with the gradient descent method.

@jacobq
Copy link
Contributor

jacobq commented Apr 16, 2019

Hi @andcastillo and sorry I haven't been helping with this library lately (I had planned to do so months ago). Would you mind elaborating on how the current implementation differs from the algorithm described by the papers/articles linked in the README? I thought the "damping factor" basically allowed LM to work as a blend of those two modes. If it's easier for you to explain with an example / PR feel free to do it that way.

@andcastillo
Copy link
Author

I will elaborate later, but up to I know, the damping value is adjusted within the optimization loop, based on the update speed. If the algorithm is changing too slowly, the damping value is increased.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants