serve
Model Server
A tool for serving and scaling PyTorch models in production environments
Serve, optimize and scale PyTorch models in production
4k stars
57 watching
860 forks
Language: Java
last commit: 29 days ago
Linked from 2 awesome lists
cpudeep-learningdockergpukubernetesmachine-learningmetricsmlopsoptimizationpytorchserving
ethicalml/awesome-production-machine-learning
kelvins/awesome-mlopsRelated projects:
| Repository | Description | Stars |
|---|---|---|
 clcarwin/convert_torch_to_pytorch | Converts PyTorch models to their Torch equivalents. | 539 |
 huggingface/accelerate | A tool to simplify training and deployment of PyTorch models on various devices and configurations | 7,947 |
| pytorch/torchtune | A library that provides an easy-to-use interface for authoring, finetuning, and experimenting with large language models | 4,320 |
 cadene/pretrained-models.pytorch | Provides pre-trained PyTorch models for various computer vision tasks and datasets. | 9,036 |
 ahkarami/deep-learning-in-production | A collection of notes and references on deploying deep learning models in production environments | 4,306 |
| pytorch/ignite | A high-level library to help with training and evaluating neural networks in PyTorch | 4,526 |
 amdegroot/ssd.pytorch | An implementation of a deep learning-based object detection system in PyTorch. | 5,146 |
| pytorch/torchtitan | A native PyTorch library for large-scale language model training with distributed training capabilities | 2,615 |
 pytorchbearer/torchbearer | A PyTorch model fitting library designed to simplify the process of training deep learning models. | 636 |
 pistony/torch-toolbox | A collection of reusable utility functions and classes to simplify PyTorch development | 417 |
 qubvel-org/segmentation_models.pytorch | A PyTorch library for building and training neural networks for image segmentation tasks. | 9,696 |
| pytorch/audio | A PyTorch module providing tools and functions for audio signal processing | 2,538 |
| pytorch/pytorch | A Python library providing tensors and dynamic neural networks with strong GPU acceleration | 83,959 |
 slabban/ros2_pytorch_cuda | Enables running PyTorch models on ROS2 using CUDA devices in a containerized environment. | 6 |
 jfzhang95/pytorch-deeplab-xception | A PyTorch implementation of the DeepLab-V3-Plus model with support for multiple backbones and datasets | 2,910 |