Liger-Kernel
LLM optimization kernels
A collection of optimized kernels and post-training loss functions for large language models
Efficient Triton Kernels for LLM Training
4k stars
40 watching
229 forks
Language: Python
last commit: about 1 month ago
Linked from 1 awesome list
finetuninggemma2llamallama3llm-trainingllmsmistralphi3tritontriton-kernels
ethicalml/awesome-production-machine-learningRelated projects:
| Repository | Description | Stars |
|---|---|---|
 mit-han-lab/llm-awq | An open-source software project that enables efficient and accurate low-bit weight quantization for large language models. | 2,593 |
 opengvlab/llama-adapter | An implementation of a method for fine-tuning language models to follow instructions with high efficiency and accuracy | 5,775 |
 alpha-vllm/llama2-accessory | An open-source toolkit for pretraining and fine-tuning large language models | 2,732 |
 young-geng/easylm | A framework for training and serving large language models using JAX/Flax | 2,428 |
 modeltc/lightllm | A Python-based framework for serving large language models with low latency and high scalability. | 2,691 |
 aksnzhy/xlearn | A high-performance machine learning package with linear models and factorization machines. | 3,087 |
 microsoft/lightgbm | A high-performance gradient boosting framework for machine learning tasks | 16,769 |
 zjh-819/llmdatahub | A curated collection of high-quality datasets for training large language models. | 2,708 |
 nlpxucan/wizardlm | Large pre-trained language models trained to follow complex instructions using an evolutionary instruction framework | 9,295 |
 pytorch/torchtitan | A native PyTorch library for training large language models using distributed parallelism and optimization techniques. | 2,765 |
 haotian-liu/llava | A system that uses large language and vision models to generate and process visual instructions | 20,683 |
 mlabonne/llm-course | A comprehensive course and resource package on building and deploying Large Language Models (LLMs) | 40,053 |
 scisharp/llamasharp | An efficient C#/.NET library for running Large Language Models (LLMs) on local devices | 2,750 |
 vllm-project/vllm | An inference and serving engine for large language models | 31,982 |
| microsoft/semantic-kernel | An SDK that integrates LLMs with conventional programming languages to create AI-powered applications. | 22,277 |