webdataset

A high-performance Python-based I/O system for large (and small) deep learning problems, with strong support for PyTorch.

GitHub

2k stars
22 watching
176 forks
Language: Python
last commit: 3 days ago
data-augmentationdeep-learningpytorchwebdatasetwebdataset-format