Cornucopia-LLaMA-Fin-Chinese

LLaMA fine tuner

A Chinese finance-focused large language model fine-tuning framework

聚宝盆(Cornucopia): 中文金融系列开源可商用大模型,并提供一套高效轻量化的垂直领域LLM训练框架(Pretraining、SFT、RLHF、Quantize等)

GitHub

589 stars
5 watching
61 forks
Language: Python
last commit: over 1 year ago
chinesefinancelarge-language-modelsllamanlpqarlhfsfttext-generationtransformers

Related projects:

Repository Description Stars
lc1332/chinese-alpaca-lora Develops and maintains a Chinese language model finetuned on LLaMA, used for text generation and summarization tasks. 711
git-cloner/llama2-lora-fine-tuning Fine-tuning the LLaMA 2 chat model using DeepSpeed and Lora for improved performance on a large dataset. 167
linksoul-ai/chinese-llama-2-7b A deep learning project providing an open-source implementation of the LLaMA2 model with Chinese and English text data 2,228
airaria/visual-chinese-llama-alpaca Develops a multimodal Chinese language model with visual capabilities 424
ymcui/macbert Improves pre-trained Chinese language models by incorporating a correction task to alleviate inconsistency issues with downstream tasks 645
ys-zong/vlguard Improves safety and helpfulness of large language models by fine-tuning them using safety-critical tasks 45
michael-wzhu/chinese-llama2 A custom Chinese version of the Meta Llama 2 model for improved Chinese language support and application 747
openlmlab/openchinesellama An incremental pre-trained Chinese large language model based on the LLaMA-7B model 234
fittentech/openllama-chinese A Chinese language large language model built from OpenLLaMA and fine-tuned on various datasets for multilingual text generation. 64
brightmart/xlnet_zh Trains a large Chinese language model on massive data and provides a pre-trained model for downstream tasks 230
roboflow/maestro A tool to streamline fine-tuning of multimodal models for vision-language tasks 1,386
kendryte/toucan-llm A large language model with 70 billion parameters designed for chatbot and conversational AI tasks 29
n-waves/multifit Reproduces results from a paper on efficient multi-lingual language model fine-tuning using a rewritten framework on top of the fastai library 284
yfzhang114/llava-align Debiasing techniques to minimize hallucinations in large visual language models 71
lich99/chatglm-finetune-lora A codebase for fine-tuning the ChatGLM-6b language model using low-rank adaptation (LoRA) and providing finetuned weights. 724