ChatGLM-finetune-LoRA

LM fine-tuner

A codebase for fine-tuning the ChatGLM-6b language model using low-rank adaptation (LoRA) and providing finetuned weights.

Code for fintune ChatGLM-6b using low-rank adaptation (LoRA)

GitHub

727 stars
8 watching
64 forks
Language: Jupyter Notebook
last commit: about 3 years ago
Linked from 1 awesome list


Backlinks from these awesome lists:

Related projects:

RepositoryDescriptionStars
git-cloner/llama2-lora-fine-tuningFine-tuning the LLaMA 2 chat model using DeepSpeed and Lora for improved performance on a large dataset.171
leks-forever/nllb-tuningThis is an experimental project for fine-tuning the NLB language model with a specific dataset and evaluating its performance on translation tasks.7
openai/finetune-transformer-lmThis project provides code and model for improving language understanding through generative pre-training using a transformer-based architecture.2,167
km1994/llmsninestorydemontowerExploring various LLMs and their applications in natural language processing and related areas1,854
li2109/langtorchBuilds composable LLM applications with Java295
scir-hi/med-chatglmFine-tunes a pre-trained language model to generate responses in the medical domain with improved accuracy.973
peremartra/large-language-model-notebooks-courseA practical course teaching large language models and their applications through hands-on projects using OpenAI API and Hugging Face library.1,338
openai/lm-human-preferencesTraining methods and tools for fine-tuning language models using human preferences1,240
bobazooba/xllmA tool for training and fine-tuning large language models using advanced techniques387
lc1332/chinese-alpaca-loraDevelops and maintains a Chinese language model finetuned on LLaMA, used for text generation and summarization tasks.711
zrrskywalker/llama-adapterFine-tunes a language model to generate human-like text based on visual instructions85
unlp-workshop/unlp-2024-shared-taskA shared task for fine-tuning large language models to answer questions and generate responses in Ukrainian.13
xionghonglin/doctorglmFine-tuning a Chinese doctor chat model based on ChatGLM-6B788
yongzhuo/chatglm-mathsDevelops and fine-tunes a math-based conversational AI model for generating solutions to arithmetic operations164
kurama622/llm.nvimEnables users to interact with large language models within Neovim for tasks like code optimization and translation.65