Megatron-DeepSpeed
Ongoing research training transformer language models at scale, including: BERT & GPT-2
AI summary
Transformer trainer
A collection of tools and scripts for training large transformer language models at scale
- stars
- 1.3K
- forks
- 220
- watching
- 24
Similar projects
Found by comparing what the projects do, not just their names.
Transformer trainer
Research tool for training large transformer language models at scale
Language model training
Trains German transformer models to improve language understanding
Language model trainer
This project provides code and model for improving language understanding through generative pre-training using a transformer-based architecture.
Large model trainer
A toolkit for training large models in a distributed manner while keeping code simple and efficient.
fastnlp/cpt482
Transformer model
A pre-trained transformer model for natural language understanding and generation tasks in Chinese
Transformer models
An implementation of deep learning transformer models in MATLAB
NLP tutorial
A comprehensive guide to using the Transformers library for natural language processing tasks
Parallelism framework
A pretraining framework for large language models using 3D parallelism and scalable training techniques
Model trainer
A PyTorch model fitting library designed to simplify the process of training deep learning models.
Quantizer
An implementation of post-training quantization algorithm for transformer models to reduce memory usage and improve inference speed
Transformer library
An implementation of transformer models in PyTorch for natural language processing tasks
Transformer framework
Provides a unified interface to various transformer models implemented in C/C++ using GGML library
Transformer toolkit
Provides a collection of reusable data transformation tools
Model trainer
Enables distributed deep learning with Keras and Spark for scalable model training
Neural networks library
An implementation of deep neural network architectures, including Transformers, in Python.
