Anima
Language model optimizer
An optimization technique for large language models allowing them to run on limited hardware resources without significant performance loss.
Moved to here: https://github.com/lyogavin/airllm
9 stars
2 watching
3 forks
last commit: 7 months ago Related projects:
| Repository | Description | Stars |
|---|---|---|
 alibaba/conv-llava | This project presents an optimization technique for large-scale image models to reduce computational requirements while maintaining performance. | 106 |
 lge-arc-advancedai/auptimizer | Automates model building and deployment process by optimizing hyperparameters and compressing models for edge computing. | 200 |
 luogen1996/lavin | An open-source implementation of a vision-language instructed large language model | 513 |
 brml/climin | A Python package for gradient-based function optimization in machine learning | 181 |
 flagai-open/aquila2 | Provides pre-trained language models and tools for fine-tuning and evaluation | 439 |
 tensorzero/tensorzero | A tool for optimizing large language models by collecting feedback and metrics to improve their performance over time | 1,245 |
 lanl-ansi/gasmodels.jl | A Julia package for optimizing gas network flow and expansion planning with various mathematical formulations. | 66 |
 openai/finetune-transformer-lm | This project provides code and model for improving language understanding through generative pre-training using a transformer-based architecture. | 2,167 |
 vaibkumr/prompt-optimizer | A tool to reduce the complexity of text prompts to minimize API costs and model computations. | 246 |
 datacanvasio/hypergbm | Automated machine learning tool for tabular data pipelines | 343 |
| openai/lm-human-preferences | Training methods and tools for fine-tuning language models using human preferences | 1,240 |
 davisyoshida/lorax | A JAX transform that simplifies the training of large language models by reducing memory usage through low-rank adaptation. | 134 |
 kvcache-ai/ktransformers | A flexible framework for LLM inference optimizations with support for multiple models and architectures | 771 |
 atisharma/matlib | A Clojure library of optimisation and control theory tools and convenience functions | 25 |
 containers-ai/alameda | An AI-powered system that analyzes and predicts resource usage in Kubernetes clusters to optimize dynamic scaling and scheduling of containers. | 11 |