Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Make IQ1_M work for QK_K = 64 #6327

Merged
merged 3 commits into from Mar 27, 2024
Merged

Make IQ1_M work for QK_K = 64 #6327

merged 3 commits into from Mar 27, 2024

Commits on Mar 26, 2024

  1. iq1_m: make it work for QK_K = 64 (WIP)

    @Kawrakow
    Kawrakow committed Mar 26, 2024
    Configuration menu
    Copy the full SHA
    e1939bc View commit details
    Browse the repository at this point in the history

  2. iq1_m: make it work for QK_K = 64 (scalar and AVX2)

    @Kawrakow
    Kawrakow committed Mar 26, 2024
    Configuration menu
    Copy the full SHA
    5c953a1 View commit details
    Browse the repository at this point in the history

  3. iq1_m: QK_K = 64 seems to work on Metal and ARM_NEON

    @Kawrakow
    Kawrakow committed Mar 26, 2024
    Configuration menu
    Copy the full SHA
    b0d0bdd View commit details
    Browse the repository at this point in the history