Popular repositories

1. KoboldAI KoboldAI Public

   Forked from henk717/KoboldAI

   Python 150 29

2. GPTQ-for-LLaMa GPTQ-for-LLaMa Public

   Forked from qwopqwop200/GPTQ-for-LLaMa

   4 bits quantization of LLMs using GPTQ

   Python 44 15

3. pinenote-misc pinenote-misc Public

   Shell 16 1

4. exllama exllama Public

   Forked from turboderp/exllama

   A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.

   Python 7 5

5. koboldcpp koboldcpp Public

   Forked from LostRuins/koboldcpp

   Port of Facebook's LLaMA model in C/C++

   C++ 6 1

6. bitsandbytes-rocm bitsandbytes-rocm Public

   Forked from broncotc/bitsandbytes-rocm

   Python 3 3