Pinned Loading

1. inference inference Public

   Forked from mlcommons/inference

   Reference implementations of MLPerf™ inference benchmarks

   Python

2. training training Public

   Forked from mlcommons/training

   Reference implementations of MLPerf™ training benchmarks

   Python

3. microsoft/pai microsoft/pai Public archive

   Resource scheduling and cluster management for AI

   JavaScript 2.6k 545

4. TensorRT-LLM TensorRT-LLM Public

   Forked from NVIDIA/TensorRT-LLM

   TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…

   C++

5. DeepSpeed DeepSpeed Public

   Forked from microsoft/DeepSpeed

   DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

   Python

6. DeepSpeed-MII DeepSpeed-MII Public

   Forked from microsoft/DeepSpeed-MII

   MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.

   Python