Chinese-Mixtral
by ymcui
中文Mixtral混合专家大模型（Chinese Mixtral MoE LLMs）
AI summary
Mixtral model developer
Develops and releases Mixtral-based models for natural language processing tasks with a focus on Chinese text generation and understanding
- stars
- 589
- forks
- 43
- watching
- 15
Similar projects
Found by comparing what the projects do, not just their names.
Chinese Text Model
An implementation of a large language model for Chinese text processing, focusing on MoE (Multi-Headed Attention) architecture and incorporating a vast vocabulary.
Chinese NLP Models
Provides pre-trained models for Chinese natural language processing tasks using the XLNet architecture
Chinese language model fine-tuning tool
Improves pre-trained Chinese language models by incorporating a correction task to alleviate inconsistency issues with downstream tasks
MobileBERT model
An implementation of MobileBERT, a pre-trained language model, in Python for NLP tasks.
Chinese NLP library
Provides pre-trained Chinese language models based on the ELECTRA framework for natural language processing tasks
Linguistic Model
A pre-trained language model designed to leverage linguistic features and outperform comparable baselines on Chinese natural language understanding tasks.
Chinese language model
Trains a large Chinese language model on massive data and provides a pre-trained model for downstream tasks
Semantic learning model
Develops a pre-trained language model to learn semantic knowledge from permuted text without mask labels
Medical LLM
Develops and deploys a large language model for Chinese traditional medicine applications
Mixture-of-Experts Model
Developed by XVERSE Technology Inc. as a multilingual large language model with a unique mixture-of-experts architecture and fine-tuned for various tasks such as conversation, question answering, and natural language understanding.
Multilingual Model
Develops and publishes large multilingual language models with advanced mixing-of-experts architecture.
Chinese NLU/NGL toolkit
This project provides pre-trained models and tools for natural language understanding (NLU) and generation (NLG) tasks in Chinese.
Chinese Llama Model
A custom Chinese version of the Meta Llama 2 model for improved Chinese language support and application
Multimodal LLM
A multi-modal large language model that integrates natural language and visual capabilities with fine-tuning for various tasks
Mixture of Experts Model
A large vision-language model using a mixture-of-experts architecture to improve performance on multi-modal learning tasks
