Anima
Language model optimizer
An optimization technique for large language models allowing them to run on limited hardware resources without significant performance loss.
Moved to here: https://github.com/lyogavin/airllm
6 stars
2 watching
3 forks
last commit: 4 months ago Related projects:
| Repository | Description | Stars |
|---|---|---|
 alibaba/conv-llava | This project presents an optimization technique for large-scale image models to reduce computational requirements while maintaining performance. | 104 |
 lge-arc-advancedai/auptimizer | Automates model building and deployment process by optimizing hyperparameters and compressing models for edge computing. | 200 |
 luogen1996/lavin | An open-source implementation of a vision-language instructed large language model | 508 |
 brml/climin | A framework for optimizing machine learning functions using gradient-based optimization methods. | 180 |
 flagai-open/aquila2 | Provides pre-trained language models and tools for fine-tuning and evaluation | 437 |
 tensorzero/tensorzero | A tool that creates a feedback loop to optimize large language models by integrating model gateways and providing data analytics and machine learning capabilities. | 569 |
 lanl-ansi/gasmodels.jl | A Julia package for optimizing gas network flow and expansion planning with various mathematical formulations. | 65 |
 openai/finetune-transformer-lm | This project provides code and model for improving language understanding through generative pre-training using a transformer-based architecture. | 2,160 |
 vaibkumr/prompt-optimizer | A tool to reduce the complexity of text prompts to minimize API costs and model computations. | 241 |
 datacanvasio/hypergbm | An AutoML toolkit designed to automate the entire machine learning process pipeline for tabular data | 337 |
| openai/lm-human-preferences | Training methods and tools for fine-tuning language models using human preferences | 1,229 |
 davisyoshida/lorax | A JAX transform that simplifies the training of large language models by reducing memory usage through low-rank adaptation. | 132 |
 kvcache-ai/ktransformers | A flexible framework for LLM inference optimizations with support for multiple models and architectures | 736 |
 atisharma/matlib | A Clojure library of optimisation and control theory tools and convenience functions | 25 |
 containers-ai/alameda | An AI-powered system that analyzes and predicts resource usage in Kubernetes clusters to optimize dynamic scaling and scheduling of containers. | 11 |