sparktorch
Deep learning framework
A PyTorch implementation on Apache Spark for distributed deep learning model training and inference.
Train and run Pytorch models on Apache Spark.
339 stars
10 watching
45 forks
Language: Python
last commit: over 2 years ago apache-sparkdeep-learningdistributed-computinginferencepipelinespytorchsparktorch
Related projects:
| Repository | Description | Stars |
|---|---|---|
 lensacom/sparkit-learn | A Python library that integrates PySpark and scikit-learn for distributed machine learning | 1,154 |
 learning-at-home/hivemind | A PyTorch library for decentralized deep learning across the Internet. | 2,078 |
 eduardoleao052/js-pytorch | A JavaScript library that provides GPU-accelerated deep learning capabilities with automatic differentiation and neural network layers. | 1,093 |
 dmarnerides/pydlt | A PyTorch-based toolbox for building and training deep learning models with ease. | 204 |
 lightning-universe/lightning-bolts | Provides a toolbox of components to extend PyTorch Lightning for deep learning research and production | 1,700 |
 erotemic/netharn | A PyTorch framework for managing and automating deep learning training loops with features like hyperparameter tracking and single-file deployments. | 40 |
 zhanghang1989/pytorch-encoding | A Python framework for building deep learning models with optimized encoding layers and batch normalization. | 2,044 |
 rdspring1/pytorch_gbw_lm | Trains a large-scale PyTorch language model on the 1-Billion Word dataset | 123 |
 ne7ermore/torch-light | A comprehensive collection of deep learning examples using PyTorch, covering various applications and models. | 537 |
 open-mmlab/mmengine | Provides a flexible and configurable framework for training deep learning models with PyTorch. | 1,196 |
 maxpumperla/elephas | Enables distributed deep learning with Keras and Spark for scalable model training | 1,574 |
 torch/cutorch | Provides a CUDA backend for the PyTorch deep learning framework | 337 |
 furkanu/deeplearning.ai-pytorch | Re-implementation of Coursera's Deep Learning specialization assignments in PyTorch | 149 |
 shenzebang/federated-learning-pytorch | A PyTorch-based framework for Federated Learning experiments | 40 |
 rguthrie3/deeplearningfornlpinpytorch | A comprehensive tutorial on deep learning for natural language processing with PyTorch, covering the basics and advancing to linguistic structure prediction. | 1,942 |