nanotron
by huggingface
Pythonpushed almost 2 years ago
Minimalistic large language model 3D-parallelism training
AI summary
Parallelism framework
A pretraining framework for large language models using 3D parallelism and scalable training techniques
- stars
- 1.3K
- forks
- 132
- watching
- 43
- awesome list
- 1
Featured in 1 awesome list
Each link jumps to the spot where the list mentions nanotron.