LMFlow
Language Model Finetuner
A toolkit for finetuning large language models and providing efficient inference capabilities
An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.
8k stars
71 watching
826 forks
Language: Python
last commit: 7 days ago
Linked from 1 awesome list
chatgptdeep-learninginstruction-followinglanguage-modelpretrained-modelspytorchtransformer
ethicalml/awesome-production-machine-learningRelated projects:
| Repository | Description | Stars |
|---|---|---|
 microsoft/lmops | A research initiative focused on developing fundamental technology to improve the performance and efficiency of large language models. | 3,695 |
 modeltc/lightllm | An LLM inference and serving framework providing a lightweight design, scalability, and high-speed performance for large language models. | 2,609 |
 alpha-vllm/llama2-accessory | An open-source toolkit for pretraining and fine-tuning large language models | 2,720 |
 eleutherai/lm-evaluation-harness | Provides a unified framework to test generative language models on various evaluation tasks. | 6,970 |
 modelscope/ms-swift | A framework for fine-tuning and deploying large language models | 4,270 |
 mlabonne/llm-course | A comprehensive course and resource package on building and deploying Large Language Models (LLMs) | 39,120 |
 mit-han-lab/llm-awq | A tool for efficient and accurate weight quantization in large language models | 2,517 |
 aksnzhy/xlearn | A high-performance machine learning package with linear models and factorization machines. | 3,087 |
 internlm/lmdeploy | A toolkit for optimizing and serving large language models | 4,653 |
 zjh-819/llmdatahub | A curated collection of high-quality datasets for training large language models. | 2,635 |
 lyogavin/airllm | A Python library that optimizes inference memory usage for large language models on limited GPU resources. | 5,259 |
 intel/neural-compressor | Tools and techniques for optimizing large language models on various frameworks and hardware platforms. | 2,226 |
 ludwig-ai/ludwig | A low-code framework for building custom deep learning models and neural networks | 11,189 |
| microsoft/flaml | Automates machine learning workflows and optimizes model performance using large language models and efficient algorithms | 3,919 |
 stability-ai/stablelm | Develops and maintains large language models with improved stability and performance | 15,828 |