LMFlow
LLM toolkit
A toolkit for fine-tuning and inferring large machine learning models
An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.
8k stars
72 watching
827 forks
Language: Python
last commit: over 1 year agoLinked from 1 awesome list
chatgptdeep-learninginstruction-followinglanguage-modelpretrained-modelspytorchtransformer
ethicalml/awesome-production-machine-learningRelated projects:
| Repository | Description | Stars |
|---|---|---|
 microsoft/lmops | A research initiative focused on developing fundamental technology to improve the performance and efficiency of large language models. | 3,747 |
 modeltc/lightllm | A Python-based framework for serving large language models with low latency and high scalability. | 2,691 |
 alpha-vllm/llama2-accessory | An open-source toolkit for pretraining and fine-tuning large language models | 2,732 |
 eleutherai/lm-evaluation-harness | Provides a unified framework to test generative language models on various evaluation tasks. | 7,200 |
 modelscope/ms-swift | A framework for efficient fine-tuning and deployment of large language models | 4,659 |
 mlabonne/llm-course | A comprehensive course and resource package on building and deploying Large Language Models (LLMs) | 40,053 |
 mit-han-lab/llm-awq | An open-source software project that enables efficient and accurate low-bit weight quantization for large language models. | 2,593 |
 aksnzhy/xlearn | A high-performance machine learning package with linear models and factorization machines. | 3,087 |
 internlm/lmdeploy | A toolkit for optimizing and serving large language models | 4,854 |
 zjh-819/llmdatahub | A curated collection of high-quality datasets for training large language models. | 2,708 |
 lyogavin/airllm | Optimizes large language model inference on limited GPU resources | 5,446 |
 intel/neural-compressor | Tools and techniques for optimizing large language models on various frameworks and hardware platforms. | 2,257 |
 ludwig-ai/ludwig | A low-code framework for building custom deep learning models and neural networks | 11,236 |
| microsoft/flaml | Automates machine learning workflows and optimizes model performance using large language models and efficient algorithms | 3,968 |
 stability-ai/stablelm | Develops and maintains large language models with improved stability and performance | 15,829 |