-
Notifications
You must be signed in to change notification settings - Fork 0
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Improve GECO #3
Comments
87 "factor_nll_range" : [0.0, 1.0, 40.0], this should be allowed to become negative to prevent empty solution |
I realized that sparsity should be controlled by fg_pixel_fraction (which should be removed from regularization dictionary). Moreover the balance between reconstruction and KL should be that maybe: |
In PR #20:
KL_LOGIT is normalized w.r.t to running average. The only question is wether the other KL should also be normalized in the same way...... |
Interesting observation: |
what is the range of allowed value fo the GECO hyper-parameters (0; + infinity) ?
change of hyper-parameters should be proportional to the distance to the target
The text was updated successfully, but these errors were encountered: