optimate

Model optimizer

A collection of libraries to optimize AI model performances.

A collection of libraries to optimise AI model performances

GitHub

8k stars
93 watching
637 forks
Language: Python
last commit: 6 months ago
Linked from 4 awesome lists

aianalyticsartificial-intelligencedeeplearninglarge-language-modelsllm

Backlinks from these awesome lists:

Related projects:

Repository Description Stars
nebuly-ai/nos A module to optimize GPU utilization in Kubernetes clusters through dynamic partitioning and elastic resource management. 636
nvidia/nemo A scalable generative AI framework for creating and deploying large language models and multimodal models 12,438
optuna/optuna A framework for automating and accelerating the optimization of machine learning hyperparameters 11,082
huggingface/optimum A toolkit for optimizing and accelerating the training and inference of machine learning models on various hardware platforms. 2,618
meta-llama/llama-stack Provides pre-packaged building blocks for generative AI applications with standardized APIs and service-oriented design. 5,164
optimalscale/lmflow A toolkit for fine-tuning and inferring large machine learning models 8,312
haotian-liu/llava A system that uses large language and vision models to generate and process visual instructions 20,683
plasma-umass/scalene A high-performance Python profiler that analyzes CPU, GPU, and memory usage, providing detailed information and AI-powered optimization suggestions. 12,274
nvidia/nemo-curator A toolkit for fast and scalable data preparation and curation for large language models 672
nomic-ai/gpt4all An open-source Python client for running Large Language Models (LLMs) locally on any device. 71,176
intel/neural-compressor Tools and techniques for optimizing large language models on various frameworks and hardware platforms. 2,257
tju-drl-lab/ai-optimizer A next-generation deep reinforcement learning toolkit with libraries for multiagent, self-supervised, offline, and transfer/reinforcement learning 4,848
facebook/ax An adaptive experimentation platform with support for various optimization strategies and flexible APIs. 2,392
openvinotoolkit/openvino A toolkit for optimizing and deploying artificial intelligence models in various applications 7,439
ludwig-ai/ludwig A low-code framework for building custom deep learning models and neural networks 11,236