petastorm
by uber
Pythonpushed almost 3 years ago
Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch, and PySpark and can be used from pure Python code.
AI summary
Deep learning data loader
Enables training and evaluation of deep learning models from Apache Parquet datasets in various machine learning frameworks
- stars
- 1.8K
- forks
- 284
- watching
- 40
- awesome list
- 1
Featured in 1 awesome list
Each link jumps to the spot where the list mentions petastorm.