Skip to content

Enable Quantize KV Cache for Mistral Model#35042

Merged
zucchini-nlp merged 1 commit intohuggingface:mainfrom
Bojun-Feng:enh/enable_quant_kv_mistral
May 20, 2025
Merged

Enable Quantize KV Cache for Mistral Model#35042
zucchini-nlp merged 1 commit intohuggingface:mainfrom
Bojun-Feng:enh/enable_quant_kv_mistral

Commits

Commits on Dec 2, 2024