Chinese-Mixtral-8x7B
by HIT-SCIR
中文Mixtral-8x7B（Chinese-Mixtral-8x7B）
AI summary
Chinese Text Model
An implementation of a large language model for Chinese text processing, focusing on MoE (Multi-Headed Attention) architecture and incorporating a vast vocabulary.
- stars
- 645
- forks
- 32
- watching
- 15
Similar projects
Found by comparing what the projects do, not just their names.
Mixtral model developer
Develops and releases Mixtral-based models for natural language processing tasks with a focus on Chinese text generation and understanding
Chinese language model
Trains a large Chinese language model on massive data and provides a pre-trained model for downstream tasks
Chinese understanding benchmark
Measures the understanding of massive multitask Chinese datasets using large language models
Chinese language models
Provides pre-trained models for Chinese language tasks with improved performance and smaller model sizes compared to existing models.
Chinese transformer model
A pre-trained Chinese language model based on the Transformer-XL architecture.
Chinese Semantic Dependency Parsing Dataset
A benchmarking dataset and evaluation framework for semantic dependency parsing in Chinese language texts.
Multimodal LLM
A multi-modal large language model that integrates natural language and visual capabilities with fine-tuning for various tasks
Language Model
A high-performance language model designed to excel in tasks like natural language understanding, mathematical computation, and code generation
Chinese NLU/NGL toolkit
This project provides pre-trained models and tools for natural language understanding (NLU) and generation (NLG) tasks in Chinese.
Chinese Language Model
Trains and evaluates a Chinese language model using adversarial training on a large corpus.
Language Model
This project makes a large language model accessible for research and development
Chinese model
An implementation of a Chinese language model using PyTorch and transformer architecture.
Multilingual language models
This repository provides pre-trained models and code for understanding and generation tasks in multiple languages.
Chinese NLP Models
Provides pre-trained models for Chinese natural language processing tasks using the XLNet architecture
Language Model
Large-scale language model with improved performance on NLP tasks through distributed training and efficient data processing
