Megatron-DeepSpeed
by microsoft
Ongoing research training transformer language models at scale, including: BERT & GPT-2
AI summary
Transformer trainer
Research tool for training large transformer language models at scale
- stars
- 1.9K
- forks
- 343
- watching
- 25
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
Transformer trainer
A collection of tools and scripts for training large transformer language models at scale
Language model training
Trains German transformer models to improve language understanding
Transformer models
An implementation of deep learning transformer models in MATLAB
Language model trainer
This project provides code and model for improving language understanding through generative pre-training using a transformer-based architecture.
fastnlp/cpt482
Transformer model
A pre-trained transformer model for natural language understanding and generation tasks in Chinese
NLP tutorial
A comprehensive guide to using the Transformers library for natural language processing tasks
Language Model
Trains a large-scale PyTorch language model on the 1-Billion Word dataset
Parallelism framework
A pretraining framework for large language models using 3D parallelism and scalable training techniques
Region-of-Interest Training
Training and deploying large language models on computer vision tasks using region-of-interest inputs
Model trainer
Enables distributed deep learning with Keras and Spark for scalable model training
NLP toolkit
A Go package providing an easy interface to use pre-trained NLP models from the HuggingFace repository for tasks like text classification and machine translation.
Transformer framework
Provides a unified interface to various transformer models implemented in C/C++ using GGML library
Transformer library
An implementation of transformer models in PyTorch for natural language processing tasks
Communications system
An implementation of a machine learning-based communications system using deep learning techniques.
Text-to-image generator
Develops a PyTorch model for 4K text-to-image generation using diffusion transformer
Featured in 1 awesome list
Each link jumps to the spot where the list mentions Megatron-DeepSpeed.
