webdataset
IO system
A high-performance I/O system for large deep learning problems with strong support for PyTorch and flexible file handling.
A high-performance Python-based I/O system for large (and small) deep learning problems, with strong support for PyTorch.
2k stars
23 watching
189 forks
Language: Python
last commit: about 2 months ago data-augmentationdeep-learningpytorchwebdatasetwebdataset-format
Related projects:
| Repository | Description | Stars |
|---|---|---|
 victoresque/pytorch-template | An open-source PyTorch deep learning project template providing a structured environment for building and training various models. | 4,754 |
 zhanghang1989/pytorch-encoding | A Python framework for building deep learning models with optimized encoding layers and batch normalization. | 2,041 |
 donnyyou/torchcv | A comprehensive PyTorch-based framework for computer vision tasks | 2,250 |
 jolibrain/deepdetect | A machine learning API and server written in C++ that supports multiple deep learning libraries and provides a flexible interface for building and deploying machine learning models. | 2,519 |
 amdegroot/ssd.pytorch | An implementation of a deep learning-based object detection system in PyTorch. | 5,150 |
 catalyst-team/catalyst | A PyTorch framework for accelerating deep learning research and development by focusing on reproducibility, rapid experimentation, and codebase reuse. | 3,295 |
 pytorch/pytorch | A Python library providing tensors and dynamic neural networks with strong GPU acceleration | 84,371 |
 deepdoctection/deepdoctection | An integrated framework for document AI tasks using deep learning models. | 2,588 |
 ahkarami/deep-learning-in-production | A collection of notes and references on deploying deep learning models in production environments | 4,308 |
 hughperkins/pytorch | Provides Python wrappers for PyTorch and Lua, enabling developers to use PyTorch's deep learning capabilities from both languages. | 432 |
 dsksd/deepnlp-models-pytorch | Pytorch implementations of various Deep NLP models from Stanford's cs-224n course | 2,954 |
 rdspring1/pytorch_gbw_lm | Trains a large-scale PyTorch language model on the 1-Billion Word dataset | 123 |
 eduardoleao052/js-pytorch | A JavaScript library that provides GPU-accelerated deep learning capabilities with automatic differentiation and neural network layers. | 1,084 |
 deeppavlov/deeppavlov | An open-source deep learning framework for building end-to-end dialog systems and chatbots. | 6,729 |
 hpcgarage/accelerated_dl_pytorch | This repository provides tutorials and demo code for accelerated deep learning with PyTorch using Jupyter Notebook. | 127 |