ChatGLM-finetune-LoRA

LM fine-tuner

A codebase for fine-tuning the ChatGLM-6b language model using low-rank adaptation (LoRA) and providing finetuned weights.

Code for fintune ChatGLM-6b using low-rank adaptation (LoRA)

GitHub

724 stars
8 watching
64 forks
Language: Jupyter Notebook
last commit: over 1 year ago
Linked from 1 awesome list


Backlinks from these awesome lists:

Related projects:

Repository Description Stars
git-cloner/llama2-lora-fine-tuning Fine-tuning the LLaMA 2 chat model using DeepSpeed and Lora for improved performance on a large dataset. 167
leks-forever/nllb-tuning This is an experimental project for fine-tuning the NLB language model with a specific dataset and evaluating its performance on translation tasks. 7
openai/finetune-transformer-lm This project provides code and model for improving language understanding through generative pre-training using a transformer-based architecture. 2,160
km1994/llmsninestorydemontower Exploring various LLMs and their applications in natural language processing and related areas 1,798
li2109/langtorch Builds composable LLM applications with Java 294
scir-hi/med-chatglm Fine-tunes a pre-trained language model to generate responses in the medical domain with improved accuracy. 963
peremartra/large-language-model-notebooks-course A practical course teaching large language models and their applications through hands-on projects using OpenAI API and Hugging Face library. 1,281
openai/lm-human-preferences Training methods and tools for fine-tuning language models using human preferences 1,229
bobazooba/xllm A tool for training and fine-tuning large language models using advanced techniques 380
lc1332/chinese-alpaca-lora Develops and maintains a Chinese language model finetuned on LLaMA, used for text generation and summarization tasks. 711
zrrskywalker/llama-adapter Fine-tunes a language model to generate human-like text based on visual instructions 85
unlp-workshop/unlp-2024-shared-task A shared task for fine-tuning large language models to answer questions and generate responses in Ukrainian. 13
xionghonglin/doctorglm Fine-tuning a Chinese doctor chat model based on ChatGLM-6B 777
yongzhuo/chatglm-maths Develops and fine-tunes a math-based conversational AI model for generating solutions to arithmetic operations 163
kurama622/llm.nvim An extension for Neovim that integrates with large language models to provide tools for text translation, code explanation and optimization. 47