Pinned

1. intel/intel-extension-for-transformers intel/intel-extension-for-transformers Public

   ⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡

   Python 2k 186

2. intel/neural-compressor intel/neural-compressor Public

   SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime

   Python 2k 238