Skip to content

vulkan: Split large mul_mat_id to fit in shared memory #14451

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

jeffbolznv
Copy link
Collaborator

Fixes #14426.

@jeffbolznv jeffbolznv requested a review from 0cc4m June 29, 2025 20:10
@github-actions github-actions bot added testing Everything test related Vulkan Issues specific to the Vulkan backend ggml changes relating to the ggml tensor library for machine learning labels Jun 29, 2025
@jeffbolznv jeffbolznv force-pushed the mul_mat_id_splitting branch from d383e13 to 83fdde1 Compare June 30, 2025 03:25
@jeffbolznv jeffbolznv force-pushed the mul_mat_id_splitting branch from 83fdde1 to 8e9ddef Compare June 30, 2025 18:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ggml changes relating to the ggml tensor library for machine learning testing Everything test related Vulkan Issues specific to the Vulkan backend
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Eval bug: GGML_ASSERT(nei0 * nei1 <= 4096) failed when setting ubatch to 2048 on Qwen 3-30B
2 participants