Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ERROR lora diffusion_model.double_blocks.16.txt_attn.proj.weight "addmm_cuda" not implemented for 'Float8_e4m3fn' #150

Open
hong2610 opened this issue Nov 9, 2024 · 0 comments

Comments

@hong2610
Copy link

hong2610 commented Nov 9, 2024

This option only appears when <weight_dtype> is selected in - <weight_dtype>. It does not appear when <fp8_e5m2> is selected.
cuda11.8升级到12.4时出现这个异常,但是仍然出图。unet加载器flux-dev-fp8.safetensors枝剪类型选择<weight_dtype>有错误信息,选其他两个<fp8_e5m2>没有错误信息。
pytorch version: 2.5.0+cu124
xformers version: 0.0.28.post2
屏幕截图 2024-11-09 103143
屏幕截图 22024-11-09 103530

model weight dtype torch.float8_e4m3fn, manual cast: torch.bfloat16 model_type FLUX Requested to load Flux Loading 1 new model loaded partially 10745.827979049682 10745.7216796875 46 ERROR lora diffusion_model.double_blocks.0.img_attn.qkv.weight "addmm_cuda" not implemented for 'Float8_e4m3fn' ................ ERROR lora diffusion_model.double_blocks.16.txt_attn.proj.weight "addmm_cuda" not implemented for 'Float8_e4m3fn' ERROR lora diffusion_model.double_blocks.17.img_attn.proj.weight "addmm_cuda" not implemented for 'Float8_e4m3fn' ERROR lora diffusion_model.double_blocks.17.txt_attn.proj.weight "addmm_cuda" not implemented for 'Float8_e4m3fn' ERROR lora diffusion_model.double_blocks.18.img_attn.proj.weight "addmm_cuda" not implemented for 'Float8_e4m3fn' ERROR lora diffusion_model.double_blocks.18.txt_attn.proj.weight "addmm_cuda" not implemented for 'Float8_e4m3fn'

@hong2610 hong2610 changed the title Help, cuda 11.8 level to 12.4. The console shows an exception, but the image is still being drawn. ERROR lora diffusion_model.double_blocks.16.txt_attn.proj.weight "addmm_cuda" not implemented for 'Float8_e4m3fn' Nov 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant