serve
Model Server
A tool for serving and scaling PyTorch models in production environments
Serve, optimize and scale PyTorch models in production
4k stars
57 watching
865 forks
Language: Java
last commit: 11 months ago
Linked from 2 awesome lists
cpudeep-learningdockergpukubernetesmachine-learningmetricsmlopsoptimizationpytorchserving
ethicalml/awesome-production-machine-learning
kelvins/awesome-mlopsRelated projects:
| Repository | Description | Stars |
|---|---|---|
 clcarwin/convert_torch_to_pytorch | Converts PyTorch models to their Torch equivalents. | 541 |
 huggingface/accelerate | A tool to simplify training and deployment of PyTorch models on various devices and configurations | 8,056 |
| pytorch/torchtune | A PyTorch library for easily authoring and experimenting with large language models | 4,479 |
 cadene/pretrained-models.pytorch | Provides pre-trained PyTorch models for various computer vision tasks and datasets. | 9,044 |
 ahkarami/deep-learning-in-production | A collection of notes and references on deploying deep learning models in production environments | 4,313 |
| pytorch/ignite | A high-level library to help with training and evaluating neural networks in PyTorch | 4,554 |
 amdegroot/ssd.pytorch | An implementation of a deep learning-based object detection system in PyTorch. | 5,160 |
| pytorch/torchtitan | A native PyTorch library for training large language models using distributed parallelism and optimization techniques. | 2,765 |
 pytorchbearer/torchbearer | A PyTorch model fitting library designed to simplify the process of training deep learning models. | 636 |
 pistony/torch-toolbox | A collection of reusable utility functions and classes to simplify PyTorch development | 416 |
 qubvel-org/segmentation_models.pytorch | A comprehensive library for training and applying deep learning models for image segmentation | 9,829 |
| pytorch/audio | A PyTorch module providing tools and functions for audio signal processing | 2,561 |
| pytorch/pytorch | A Python library providing tensors and dynamic neural networks with strong GPU acceleration | 84,978 |
 slabban/ros2_pytorch_cuda | Enables running PyTorch models on ROS2 using CUDA devices in a containerized environment. | 7 |
 jfzhang95/pytorch-deeplab-xception | A PyTorch implementation of the DeepLab-V3-Plus model with support for multiple backbones and datasets | 2,919 |