torchgpipe

A GPipe implementation in PyTorch

804 stars

33 watching

98 forks

Language: Python

last commit: 2 months ago

checkpointingdeep-learninggpipemodel-parallelismparallelismpipeline-parallelismpytorch