BentoML
by bentoml
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
AI summary
AI API service
An open-source Python framework for building model inference APIs and serving AI models in production environments.
- stars
- 7.2K
- forks
- 795
- watching
- 77
- awesome lists
- 3
Similar projects
Found by comparing what the projects do, not just their names.
AI toolkit
Provides pre-packaged building blocks for generative AI applications with standardized APIs and service-oriented design.
jina-ai/serve21.2K
AI service framework
A framework for building and deploying AI services that can be scaled from local development to production
mindsdb/mindsdb26.9K
AI query agent
A platform for building AI agents that can learn from and answer questions across multiple data sources using machine learning and natural language processing.
AI service builder
An AI service building framework using Python to simplify the development of machine learning models and services.
fedml-ai/fedml4.2K
ML framework
A unified and scalable machine learning library for large-scale distributed training, model serving, and federated learning.
ludwig-ai/ludwig11.2K
Deep Learning Framework
A low-code framework for building custom deep learning models and neural networks
LLM toolkit
A toolkit for fine-tuning and inferring large machine learning models
exo-explore/exo17.4K
AI cluster framework
An experimental software framework to run AI models on diverse devices without requiring expensive GPUs.
ML model server
A high-performance serving system for machine learning models in production environments.
replicate/cog8.2K
Model deployer
A tool for packaging and deploying machine learning models in a standard, production-ready container environment.
LLM inference framework
A high-performance LLM inference framework written in Rust
Microservice generator
Automates conversion of machine learning code into production-ready microservices with web API and GUI.
mockoon/mockoon6.7K
Mock API tool
A tool to design and run mock APIs locally, allowing developers to speed up development, test applications in a controlled environment, and simulate edge cases.
Model deployment notes
A collection of notes and references on deploying deep learning models in production environments
deepset-ai/haystack18.1K
LLM orchestrator
An AI orchestration framework to build customizable LLM applications with advanced retrieval methods.
Featured in 3 awesome lists
Each link jumps to the spot where the list mentions BentoML.
