optimate

Model optimizer

A collection of libraries to optimize AI model performances.

A collection of libraries to optimise AI model performances

GitHub

8k stars
93 watching
639 forks
Language: Python
last commit: 4 months ago
Linked from 4 awesome lists

aianalyticsartificial-intelligencedeeplearninglarge-language-modelsllm

Backlinks from these awesome lists:

Related projects:

Repository Description Stars
nebuly-ai/nos A module to optimize GPU utilization in Kubernetes clusters through dynamic partitioning and elastic resource management. 630
nvidia/nemo A scalable generative AI framework for creating and deploying large language models and multimodal models 12,191
optuna/optuna A framework for automating and accelerating the optimization of machine learning hyperparameters 10,955
huggingface/optimum A toolkit providing optimization tools and hardware acceleration for training and inference of machine learning models 2,572
meta-llama/llama-stack Provides a set of standardized APIs and tools to build generative AI applications 4,591
optimalscale/lmflow A toolkit for finetuning large language models and providing efficient inference capabilities 8,273
haotian-liu/llava A system that uses large language and vision models to generate and process visual instructions 20,359
plasma-umass/scalene A high-performance Python profiler that analyzes CPU, GPU, and memory usage, providing detailed information and AI-powered optimization suggestions. 12,186
nvidia/nemo-curator A tool for efficiently preparing and curating large datasets for AI model training, leveraging GPU acceleration. 609
nomic-ai/gpt4all An open-source Python client for running Large Language Models (LLMs) locally on any device. 70,694
intel/neural-compressor Tools and techniques for optimizing large language models on various frameworks and hardware platforms. 2,229
tju-drl-lab/ai-optimizer A next-generation deep reinforcement learning toolkit with libraries for multiagent, self-supervised, offline, and transfer/reinforcement learning 4,755
facebook/ax An adaptive experimentation platform with support for various optimization strategies and flexible APIs. 2,378
openvinotoolkit/openvino A toolkit for optimizing and deploying artificial intelligence models in various applications 7,321
ludwig-ai/ludwig A low-code framework for building custom deep learning models and neural networks 11,189