gpt-neox
by EleutherAI
An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries
AI summary
Language model trainer
Provides a framework for training large-scale language models on GPUs with advanced features and optimizations.
- stars
- 7K
- forks
- 1K
- watching
- 125
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
nvidia/megatron-lm10.8K
LLM trainer
A framework for training large language models using scalable and optimized GPU techniques
karpathy/mingpt20.5K
Transformer model
A minimal PyTorch implementation of a transformer-based language model
Transformer trainer
Research tool for training large transformer language models at scale
Transformer platform
A codebase for working with Open Pre-trained Transformers, enabling deployment and fine-tuning of transformer models on various platforms.
Inference engine
A high-performance inference engine for transformer models
openai/gpt-222.6K
Language model repository
A repository providing code and models for research into language modeling and multitask learning
Knowledge analyzer
Analyzing knowledge development and evolution in large language models during training
Model optimizer
A package for optimizing large language models for efficient inference on GPUs and other hardware platforms.
Transformer trainer
A collection of tools and scripts for training large transformer language models at scale
Deep learning implementations
Implementations of various deep learning algorithms and techniques with accompanying documentation
Search algorithm library
An open-source library providing efficient implementations of search algorithms for reinforcement learning
ther1d/shell_gpt9.9K
AI assistant
A command-line tool using AI-powered language models to generate shell commands and code snippets
Vision transformer framework
Provides pre-trained models and code for training vision transformers and mixers using JAX/Flax
carperai/trlx4.5K
RL Framework
A framework for distributed reinforcement learning of large language models with human feedback
huggingface/peft16.7K
Parameter adaptation
An efficient method for fine-tuning large pre-trained models by adapting only a small fraction of their parameters
Featured in 1 awesome list
Each link jumps to the spot where the list mentions gpt-neox.
