torchgpipe
by kakaobrain
Pythonpushed about 2 years ago
A GPipe implementation in PyTorch
AI summary
Pipeline Parallelism Library
A PyTorch-based library for efficient training of large neural networks using pipeline parallelism and automatic recomputation of gradients.
- stars
- 820
- forks
- 100
- watching
- 33