Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Can I have request? #15

Closed
Mescalamba opened this issue Mar 18, 2025 · 2 comments
Closed

Can I have request? #15

Mescalamba opened this issue Mar 18, 2025 · 2 comments

Comments

@Mescalamba
Copy link

Mescalamba commented Mar 18, 2025

Basically only thing I would like is to be able to select level of quantitization for Alpha and/or Zero quantitizers.

Cant make any other quantitizer work, only Zero worked for example on CyberRealistic PONY.

@calcuis
Copy link
Owner

calcuis commented Mar 19, 2025

alpha works for most of the models in civitai; since those are based on sd to sdxl framework and some of them (the latest 6 months) are flux; zero is direct and simple; however, these two are convertors, not quantizers; we do write py scripts to convert the model straight to the lower tier(s) but due to some formatting issue(s), c/c++ works better recently; for the time being, you could try the cutter to further quantize the converted model file; see does it work or not

@Mescalamba
Copy link
Author

Ah, I understand to some level. I think regular quant is a bit more than just "cut to bits". LLMs have even iq quants, which we sadly dont have for visual models that perform even better than regular ones. Kinda hope it can be done one day too, altho we do have SVDquants so.. maybe not needed.

Anyway, I managed to actually run City96 implementation, so no problem. Thanks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants