Quantized KV Cache#30483

zucchini-nlp merged 21 commits intohuggingface:mainhuggingface/transformers:mainfrom

zucchini-nlp:quantzucchini-nlp/transformers:quantCopy head branch name to clipboard