DeepSpeed-MII
by microsoft
MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.
AI summary
Inference accelerator
A Python library designed to accelerate model inference with high-throughput and low latency capabilities
- stars
- 1.9K
- forks
- 175
- watching
- 42
- awesome lists
- 2
Similar projects
Found by comparing what the projects do, not just their names.
utensor/utensor1.7K
ML inference library
A lightweight machine learning inference framework built on Tensorflow optimized for Arm targets.
Inference engine
An onnx inference engine for embedded devices with hardware acceleration support
Localizer
Improves image restoration performance by converting global operations to local ones during inference
xilinx/finn770
FPGA accelerator
Fast and scalable neural network inference framework for FPGAs.
Network tuner
Automates the search for optimal neural network configurations in deep learning applications
Transformer trainer
Research tool for training large transformer language models at scale
Feature learner
An algorithm for learning feature representations in multi-layer networks
Model deployer
An open-source framework that enables the deployment and serving of PyTorch models in various acceleration frameworks.
ML server builder
Automates the setup and training of machine learning algorithms on remote servers
Model optimizer
Automates model building and deployment process by optimizing hyperparameters and compressing models for edge computing.
ML library
A machine learning library with GPU, CPU, and WASM backends for building neural networks.
Machine Learning Engine
An asynchronous engine for continuous and autonomous machine learning
Model optimizer
Tools and techniques for optimizing large language models on various frameworks and hardware platforms.
Model benchmarking suite
Measures the performance of deep learning models in various deployment scenarios.
Featured in 2 awesome lists
Each link jumps to the spot where the list mentions DeepSpeed-MII.
