Megatron-LM
by NVIDIA
Ongoing research training transformer models at scale
AI summary
LLM trainer
A framework for training large language models using scalable and optimized GPU techniques
- stars
- 10.8K
- forks
- 2.4K
- watching
- 165
- awesome lists
- 4
Similar projects
Found by comparing what the projects do, not just their names.
Language model trainer
Provides a framework for training large-scale language models on GPUs with advanced features and optimizations.
Transformer trainer
Research tool for training large transformer language models at scale
LLM trainer
A native PyTorch library for training large language models using distributed parallelism and optimization techniques.
Vision transformer framework
Provides pre-trained models and code for training vision transformers and mixers using JAX/Flax
Transformer trainer
A collection of tools and scripts for training large transformer language models at scale
Transformer platform
A codebase for working with Open Pre-trained Transformers, enabling deployment and fine-tuning of transformer models on various platforms.
microsoft/lmops3.7K
LLM booster
A research initiative focused on developing fundamental technology to improve the performance and efficiency of large language models.
haotian-liu/llava20.7K
Visual Instruction System
A system that uses large language and vision models to generate and process visual instructions
Transformer component
A high-performance transformer-based NLP component optimized for GPU acceleration and integration into various frameworks.
Language model backend
Implementations of a neural network architecture for language modeling
Inference engine
A high-performance inference engine for transformer models
Multimodal model developer
Develops large multimodal models for various computer vision tasks including image and video analysis
huggingface/trl10.3K
Transformer model trainer
A library designed to train transformer language models with reinforcement learning using various optimization techniques and fine-tuning methods.
Model repository
A collection of pre-trained machine learning models for various natural language and computer vision tasks, enabling developers to fine-tune and deploy these models on their own projects.
LLM toolkit
An open-source toolkit for pretraining and fine-tuning large language models
Featured in 4 awesome lists
Each link jumps to the spot where the list mentions Megatron-LM.
