llama2-lora-fine-tuning
Chatbot fine-tuning
Fine-tuning the LLaMA 2 chat model using DeepSpeed and Lora for improved performance on a large dataset.
llama2 finetuning with deepspeed and lora
171 stars
3 watching
14 forks
Language: Python
last commit: over 1 year ago deepspeedfinetuningllama2lora
Related projects:
| Repository | Description | Stars |
|---|---|---|
 lich99/chatglm-finetune-lora | A codebase for fine-tuning the ChatGLM-6b language model using low-rank adaptation (LoRA) and providing finetuned weights. | 727 |
 jerry1993-tech/cornucopia-llama-fin-chinese | A Chinese finance-focused large language model fine-tuning framework | 596 |
 salt-nlp/llavar | An open-source project that enhances visual instruction tuning for text-rich image understanding by integrating GPT-4 models with multimodal datasets. | 259 |
 juncongmoo/chatllama | An open source implementation of LLaMA-based chatbots using reinforcement learning from human feedback for faster training and inference | 1,209 |
 noizu-labs-ml/ex_llama | Provides Elixir bindings for interacting with a machine learning chat model using C++ | 10 |
 soulteary/docker-llama2-chat | An implementation of LLaMA2 in Docker, allowing users to quickly deploy and run the model on their local machine. | 537 |
 lc1332/chinese-alpaca-lora | Develops and maintains a Chinese language model finetuned on LLaMA, used for text generation and summarization tasks. | 711 |
 zrrskywalker/llama-adapter | Fine-tunes a language model to generate human-like text based on visual instructions | 85 |
 linksoul-ai/chinese-llama-2-7b | A deep learning project providing an open-source implementation of the LLaMA2 model with Chinese and English text data | 2,235 |
 openai/lm-human-preferences | Training methods and tools for fine-tuning language models using human preferences | 1,240 |
 dicklesworthstone/swiss_army_llama | A FastAPI service that facilitates semantic text search using precomputed embeddings and advanced similarity measures. | 947 |
 shm007g/llama-cult-and-more | Provides insights and practical guides for building and using large language models. | 427 |
 llmkira/openaibot | A chatbot platform that integrates with various messaging services and provides a plugin-based architecture for customization and extensibility | 1,956 |
 spandan-madan/pytorch_fine_tuning_tutorial | Provides guidance on fine-tuning pre-trained models for image classification tasks using PyTorch. | 279 |
 larsbaunwall/bricky | A conversational AI chatbot built using OpenAI's GPT-3 LLM and Haystack for knowledgebase indexing and retrieval. | 103 |