Liger-Kernel
Distributed LLM kernels
A collection of optimized kernels for efficient Large Language Model training on distributed computing frameworks
Efficient Triton Kernels for LLM Training
3k stars
40 watching
202 forks
Language: Python
last commit: 5 days ago
Linked from 1 awesome list
finetuninggemma2llamallama3llm-trainingllmsmistralphi3tritontriton-kernels
ethicalml/awesome-production-machine-learningRelated projects:
| Repository | Description | Stars |
|---|---|---|
 mit-han-lab/llm-awq | A tool for efficient and accurate weight quantization in large language models | 2,517 |
 opengvlab/llama-adapter | An implementation of a method for fine-tuning language models to follow instructions with high efficiency and accuracy | 5,754 |
 alpha-vllm/llama2-accessory | An open-source toolkit for pretraining and fine-tuning large language models | 2,720 |
 young-geng/easylm | A framework for training and serving large language models using JAX/Flax | 2,409 |
 modeltc/lightllm | An LLM inference and serving framework providing a lightweight design, scalability, and high-speed performance for large language models. | 2,609 |
 aksnzhy/xlearn | A high-performance machine learning package with linear models and factorization machines. | 3,087 |
 microsoft/lightgbm | A high-performance gradient boosting framework for machine learning tasks | 16,694 |
 zjh-819/llmdatahub | A curated collection of high-quality datasets for training large language models. | 2,635 |
 nlpxucan/wizardlm | Large pre-trained language models trained to follow complex instructions using an evolutionary instruction framework | 9,268 |
 pytorch/torchtitan | A native PyTorch library for large-scale language model training with distributed training capabilities | 2,615 |
 haotian-liu/llava | A system that uses large language and vision models to generate and process visual instructions | 20,232 |
 mlabonne/llm-course | A comprehensive course and resource package on building and deploying Large Language Models (LLMs) | 39,120 |
 scisharp/llamasharp | A C#/.NET library to efficiently run Large Language Models (LLMs) on local devices | 2,673 |
 vllm-project/vllm | A high-performance inference and serving engine for large language models. | 30,303 |
| microsoft/semantic-kernel | An SDK that integrates LLMs with conventional programming languages to create AI-powered applications. | 21,946 |