llm-foundry
LLM toolkit
Tools and codebase for training, fine-tuning, evaluating, and deploying large language models with Python and PyTorch.
LLM training code for Databricks foundation models
4k stars
48 watching
528 forks
Language: Python
last commit: 3 days ago deep-learningllmneural-networksnlppytorch
Related projects:
| Repository | Description | Stars |
|---|---|---|
| mosaicml/composer | A PyTorch-based deep learning training library designed to simplify large-scale model training on clusters. | 5,161 |
 mlabonne/llm-course | A comprehensive course and resource package on building and deploying Large Language Models (LLMs) | 39,120 |
 mooler0410/llmspracticalguide | A curated list of resources to help developers navigate the landscape of large language models and their applications in NLP | 9,489 |
 zjh-819/llmdatahub | A curated collection of high-quality datasets for training large language models. | 2,635 |
 explodinggradients/ragas | A toolkit for evaluating and optimizing Large Language Model applications with data-driven insights | 7,233 |
 rasbt/llms-from-scratch | Developing and pretraining a GPT-like Large Language Model from scratch | 32,908 |
 modeltc/lightllm | An LLM inference and serving framework providing a lightweight design, scalability, and high-speed performance for large language models. | 2,609 |
 llmware-ai/llmware | A framework for building enterprise LLM-based applications using small, specialized models | 6,651 |
 alpha-vllm/llama2-accessory | An open-source toolkit for pretraining and fine-tuning large language models | 2,720 |
 microsoft/lmops | A research initiative focused on developing fundamental technology to improve the performance and efficiency of large language models. | 3,695 |
 young-geng/easylm | A framework for training and serving large language models using JAX/Flax | 2,409 |
 databrickslabs/dolly | A large language model trained on a commercial machine learning platform with limited capabilities | 10,820 |
 eleutherai/lm-evaluation-harness | Provides a unified framework to test generative language models on various evaluation tasks. | 6,970 |
 optimalscale/lmflow | A toolkit for finetuning large language models and providing efficient inference capabilities | 8,273 |
 mlc-ai/mlc-llm | Enables the development, optimization, and deployment of large language models on various platforms using a unified high-performance inference engine. | 19,197 |