torchtune

LLM trainer

A PyTorch library for easily authoring and finetuning large language models with optimized training recipes

PyTorch native finetuning library

GitHub

4k stars
47 watching
449 forks
Language: Python
last commit: 1 day ago
Linked from 1 awesome list


Backlinks from these awesome lists:

Related projects:

Repository Description Stars
pytorch/torchtitan A native PyTorch library for large-scale language model training with distributed training capabilities 2,690
pytorch/audio A PyTorch module providing tools and functions for audio signal processing 2,547
pytorch/serve A tool for serving and scaling PyTorch models in production environments 4,223
alpha-vllm/llama2-accessory An open-source toolkit for pretraining and fine-tuning large language models 2,725
microsoft/torchgeo A PyTorch library providing datasets, samplers, transforms, and pre-trained models for working with geospatial data in machine learning and remote sensing applications. 2,790
opengvlab/llama-adapter An implementation of a method for fine-tuning language models to follow instructions with high efficiency and accuracy 5,763
ahkarami/deep-learning-in-production A collection of notes and references on deploying deep learning models in production environments 4,311
meta-llama/llama-recipes Provides tools and examples for fine-tuning the Meta Llama model and building applications with it 15,396
lucidrains/musiclm-pytorch Implementation of Google's MusicLM model for music generation using attention networks and text-conditioning. 3,179
hiyouga/llama-factory A tool for efficiently fine-tuning large language models across multiple architectures and methods. 35,410
pytorch/ignite A high-level library to help with training and evaluating neural networks in PyTorch 4,544
huggingface/accelerate A tool to simplify training and deployment of PyTorch models on various devices and configurations 8,010
vermeille/torchelie A collection of utility functions and tools for building deep learning models with PyTorch 111
rasbt/llms-from-scratch Developing and pretraining a GPT-like Large Language Model from scratch 34,213
antixk/pytorch-vae A collection of Variational AutoEncoder implementations in PyTorch 6,724