Pinned Loading

1. Awesome-LLM-Inference Awesome-LLM-Inference Public

   Forked from DefTruth/Awesome-LLM-Inference

   📖A curated list of Awesome LLM/VLM Inference Papers with codes, such as FlashAttention, PagedAttention, Parallelism, etc. 🎉🎉

2. llama.cpp llama.cpp Public

   Forked from ggml-org/llama.cpp

   LLM inference in C/C++

   C++

3. whisper.cpp whisper.cpp Public

   Forked from ggerganov/whisper.cpp

   Port of OpenAI's Whisper model in C/C++

   C++

4. ggml ggml Public

   Forked from ggml-org/ggml

   Tensor library for machine learning

   C++

5. open-thoughts open-thoughts Public

   Forked from open-thoughts/open-thoughts

   Open Thoughts: Fully Open Data Curation for Thinking Models

   Python

6. sherpa-onnx sherpa-onnx Public

   Forked from k2-fsa/sherpa-onnx

   Speech-to-text, text-to-speech, and speaker recongition using next-gen Kaldi with onnxruntime without Internet connection. Support embedded systems, Android, iOS, Raspberry Pi, RISC-V, x86_64 serve…

   C++