DeepSpeed
by microsoft
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
AI summary
Deep Learning Optimizer
A deep learning optimization library that simplifies distributed training and inference on modern computing hardware.
- stars
- 35.9K
- forks
- 4.2K
- watching
- 346
- awesome lists
- 6
Similar projects
Found by comparing what the projects do, not just their names.
LLM inference engine
An efficient Large Language Model inference engine leveraging consumer-grade GPUs on PCs
Inference accelerator
A Python library designed to accelerate model inference with high-throughput and low latency capabilities
Mixture-of-Experts Language Model
A high-performance mixture-of-experts language model with strong performance and efficient inference capabilities.
Inference runtime
A sparsity-aware deep learning inference runtime for CPUs that optimizes neural network performance on CPU hardware.
Language model trainer
Provides a framework for training large-scale language models on GPUs with advanced features and optimizations.
Paper Notes
A collection of notes and summaries on various deep learning research papers, including their topics, techniques, and applications.
ML framework
A machine learning API and server written in C++ that supports multiple deep learning libraries and provides a flexible interface for building and deploying machine learning models.
paddlepaddle/paddle22.3K
Deep learning framework
A high-performance deep learning framework designed for industrial-scale training and deployment of neural networks.
coqui-ai/tts36.1K
Speech generator
A deep learning toolkit for generating human-like speech from text
Model deployer
A toolkit for easy and high-performance deployment of deep learning models on various hardware platforms
Transformer trainer
Research tool for training large transformer language models at scale
hpcaitech/colossalai38.9K
AI parallelism toolkit
A toolkit for training and deploying large AI models in parallel on distributed computing infrastructure
LLM toolkit
A toolkit for optimizing and serving large language models
deep-floyd/if7.7K
Image generator
A text-to-image synthesis model with a modular design, utilizing a frozen text encoder and cascaded pixel diffusion modules to generate photorealistic images.
Production system design
A guide to building production-ready deep learning systems for real-world applications
Featured in 6 awesome lists
Each link jumps to the spot where the list mentions DeepSpeed.
