openvino

AI inference toolkit

A toolkit for optimizing and deploying artificial intelligence models in various applications

OpenVINO™ is an open-source toolkit for optimizing and deploying AI inference

GitHub

7k stars
196 watching
2k forks
Language: C++
last commit: about 15 hours ago
Linked from 2 awesome lists

aicomputer-visiondeep-learningdeploy-aidiffusion-modelsgenerative-aigood-first-issueinferencellm-inferencenatural-language-processingnlpopenvinooptimize-aiperformance-boostrecommendation-systemspeech-recognitionstable-diffusiontransformersyolo

Backlinks from these awesome lists:

Related projects:

Repository Description Stars
openvinotoolkit/open_model_zoo A collection of pre-trained deep learning models and demo applications for accelerating inference tasks 4,102
openvinotoolkit/anomalib A deep learning library for detecting anomalies in data with algorithms and tools for benchmarking, training, and deploying models. 3,833
mlfoundations/open_flamingo A framework for training large multimodal models to generate text conditioned on images or other text. 3,742
triton-inference-server/server Provides an optimized cloud and edge inferencing solution for AI models 8,342
llmware-ai/llmware A framework for building enterprise LLM-based applications using small, specialized models 6,651
luolc/adabound An optimizer that combines the benefits of Adam and SGD algorithms 2,907
coqui-ai/tts A deep learning toolkit for generating human-like speech from text 35,453
ludwig-ai/ludwig A low-code framework for building custom deep learning models and neural networks 11,189
openai/baselines High-quality implementations of reinforcement learning algorithms for research and development purposes 15,827
imoneoi/openchat Fine-tuned language models trained on mixed-quality data 5,260
hegelai/prompttools A set of tools for testing and evaluating natural language processing models and vector databases. 2,718
open-mmlab/mmdeploy A toolset for deploying deep learning models on various devices and platforms 2,774
pytorch/botorch A PyTorch-based library for Bayesian optimization, providing a modular interface for composing and optimizing probabilistic models. 3,102
higgsfield-ai/higgsfield A framework for efficient and fault-tolerant distributed training of large neural networks on multiple GPUs. 3,293
exo-explore/exo Allows developers to run AI models on personal devices with diverse hardware configurations. 14,829