Repositories list

• DeepSpeed

  Public
  DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

  compressioninferencezero+ 10data-parallelismmodel-parallelismmixture-of-expertspipeline-parallelismbillion-parameterstrillion-parametersmachine-learning+ 3

  Python

  •

  Apache License 2.0

  •4.2k•37k•999•106•Updated Feb 9, 2025Feb 9, 2025

• DeepSpeed-MII

  Public
  MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.

  inferencedeep-learningpytorch

  Python

  •

  Apache License 2.0

  •176•2k•197•10•Updated Feb 7, 2025Feb 7, 2025

• DeepSpeedExamples

  Public
  Example models using DeepSpeed

  Python

  •

  Apache License 2.0

  •1.1k•6.3k•295•19•Updated Feb 7, 2025Feb 7, 2025

• Megatron-DeepSpeed

  Public
  Ongoing research training transformer language models at scale, including: BERT & GPT-2

  Python

  •

  Other

  •2.5k•2k•130•17•Updated Feb 7, 2025Feb 7, 2025

• DeepSpeed-Kernels

  Public
  C++

  •

  Apache License 2.0

  •12•59•1•0•Updated Feb 3, 2025Feb 3, 2025