Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

True cfg and the choice of guidance scale during inference #120

Open
ZYM-PKU opened this issue Oct 8, 2024 · 0 comments
Open

True cfg and the choice of guidance scale during inference #120

ZYM-PKU opened this issue Oct 8, 2024 · 0 comments

Comments

@ZYM-PKU
Copy link

ZYM-PKU commented Oct 8, 2024

I notice that you set the guidance_scale=1.0 during training. That makes sense when you fine-tune a distilled model using FM loss.
However, the true cfg trick (true_gs=3.5) is introduced at inference stage and you choose a guidance_scale=4.0 for both positive and negative noise prediction. I wonder if the true cfg trick is necessary and why you choose 4.0 as the guidance scale?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant