Popular repositories Loading

1. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

2. EAGLE EAGLE Public

   Forked from SafeAILab/EAGLE

   EAGLE: Lossless Acceleration of LLM Decoding by Feature Extrapolation

   Python

3. executorch executorch Public

   Forked from pytorch/executorch

   End-to-end solution for enabling on-device AI across mobile and edge devices for PyTorch models

   C++