Chinese-MobileBERT

MobileBERT model

An implementation of MobileBERT, a pre-trained language model, in Python for NLP tasks.

Chinese MobileBERT(中文MobileBERT模型)

GitHub

81 stars
3 watching
10 forks
Language: Python
last commit: almost 3 years ago

Related projects:

Repository Description Stars
ymcui/macbert Improves pre-trained Chinese language models by incorporating a correction task to alleviate inconsistency issues with downstream tasks 646
ymcui/chinese-xlnet Provides pre-trained models for Chinese natural language processing tasks using the XLNet architecture 1,652
ymcui/chinese-mixtral Develops and releases Mixtral-based models for natural language processing tasks with a focus on Chinese text generation and understanding 589
ymcui/lert A pre-trained language model designed to leverage linguistic features and outperform comparable baselines on Chinese natural language understanding tasks. 202
ymcui/chinese-electra Provides pre-trained Chinese language models based on the ELECTRA framework for natural language processing tasks 1,405
zhuiyitechnology/wobert A Word-based Chinese BERT model trained on large-scale text data using pre-trained models as a foundation 460
shannonai/chinesebert A deep learning model that incorporates visual and phonetic features of Chinese characters to improve its ability to understand Chinese language nuances 545
xiaolai-sqlai/mobilenetv3 A PyTorch implementation of the MobileNetV3 architecture with pre-trained models and training code for fine-tuning. 1,662
xiaochus/mobilenetv2 A Keras implementation of MobileNetV2 with support for training and fine-tuning 321
brightmart/xlnet_zh Trains a large Chinese language model on massive data and provides a pre-trained model for downstream tasks 230
ymcui/pert Develops a pre-trained language model to learn semantic knowledge from permuted text without mask labels 356
ieit-yuan/yuan2.0-m32 A high-performance language model designed to excel in tasks like natural language understanding, mathematical computation, and code generation 182
sww9370/rocbert A pre-trained Chinese language model designed to be robust against maliciously crafted texts 15
michael-wzhu/chinese-llama2 A custom Chinese version of the Meta Llama 2 model for improved Chinese language support and application 748
zhuiyitechnology/roformer-sim An upgraded version of SimBERT with integrated retrieval and generation capabilities 441