llm-foundry
LLM toolkit
Tools and codebase for training, fine-tuning, evaluating, and deploying large language models with Python and PyTorch.
LLM training code for Databricks foundation models
4k stars
48 watching
532 forks
Language: Python
last commit: 4 months ago deep-learningllmneural-networksnlppytorch
Related projects:
| Repository | Description | Stars |
|---|---|---|
| mosaicml/composer | A deep learning training framework that abstracts away complexities of distributed training and parallelization. | 5,190 |
 mlabonne/llm-course | A comprehensive course and resource package on building and deploying Large Language Models (LLMs) | 40,053 |
 mooler0410/llmspracticalguide | A curated list of resources to help developers navigate the landscape of large language models and their applications in NLP | 9,551 |
 zjh-819/llmdatahub | A curated collection of high-quality datasets for training large language models. | 2,708 |
 explodinggradients/ragas | A toolkit for evaluating and optimizing Large Language Model applications with objective metrics, test data generation, and seamless integrations. | 7,598 |
 rasbt/llms-from-scratch | Developing and pretraining a GPT-like Large Language Model from scratch | 35,405 |
 modeltc/lightllm | A Python-based framework for serving large language models with low latency and high scalability. | 2,691 |
 llmware-ai/llmware | A framework for building enterprise LLM-based applications using small, specialized models | 8,303 |
 alpha-vllm/llama2-accessory | An open-source toolkit for pretraining and fine-tuning large language models | 2,732 |
 microsoft/lmops | A research initiative focused on developing fundamental technology to improve the performance and efficiency of large language models. | 3,747 |
 young-geng/easylm | A framework for training and serving large language models using JAX/Flax | 2,428 |
 databrickslabs/dolly | A large language model trained on a commercial machine learning platform with limited capabilities | 10,820 |
 eleutherai/lm-evaluation-harness | Provides a unified framework to test generative language models on various evaluation tasks. | 7,200 |
 optimalscale/lmflow | A toolkit for fine-tuning and inferring large machine learning models | 8,312 |
 mlc-ai/mlc-llm | A machine learning compiler and deployment engine for large language models | 19,396 |