ColossalAI
by hpcaitech
Making large AI models cheaper, faster and more accessible
AI summary
AI parallelism toolkit
A toolkit for training and deploying large AI models in parallel on distributed computing infrastructure
- stars
- 38.9K
- forks
- 4.4K
- watching
- 385
- awesome lists
- 8
Similar projects
Found by comparing what the projects do, not just their names.
LLM inference engine
An efficient Large Language Model inference engine leveraging consumer-grade GPUs on PCs
microsoft/deepspeed35.9K
Deep Learning Optimizer
A deep learning optimization library that simplifies distributed training and inference on modern computing hardware.
AI model trainer
An open-source toolkit for training and deploying large-scale AI models on various downstream tasks with multi-modality
Language model trainer
Provides a framework for training large-scale language models on GPUs with advanced features and optimizations.
mediar-ai/screenpipe11.1K
AI agent builder
A platform for building and deploying AI agents with full context using screen recordings, allowing for 24/7 monitoring and control.
AI automation platform
A platform for building and deploying autonomous AI agents to automate complex workflows
Database extension
An open-source Postgres extension for machine learning and AI operations directly within the database.
AI backbones
A collection of efficient AI backbone architectures developed by Huawei Noah's Ark Lab.
plasma-umass/scalene12.3K
Profiler
A high-performance Python profiler that analyzes CPU, GPU, and memory usage, providing detailed information and AI-powered optimization suggestions.
exo-explore/exo17.4K
AI cluster framework
An experimental software framework to run AI models on diverse devices without requiring expensive GPUs.
LLM router
A fast and secure routing service for integrating with large language models
Vision trainer
Supports large-scale vision model training on GPU machines or Google Cloud TPUs using scalable input pipelines.
coqui-ai/tts36.1K
Speech generator
A deep learning toolkit for generating human-like speech from text
Transformer model
A PyTorch model definition and inference/sampling code repository for a powerful diffusion transformer with fine-grained Chinese understanding
AI/batch workload manager
A framework for running AI and batch workloads on any infrastructure, offering unified execution, cost savings, and high GPU availability.
Featured in 8 awesome lists
Each link jumps to the spot where the list mentions ColossalAI.
