Chinese-ELECTRA

Chinese NLP library

Provides pre-trained Chinese language models based on the ELECTRA framework for natural language processing tasks

Pre-trained Chinese ELECTRA(中文ELECTRA预训练模型)

GitHub

1k stars
26 watching
171 forks
Language: Python
last commit: almost 2 years ago
bertchinesechinese-electraelectralanguage-modelnlppre-trained-modelpytorchtensorflow

Related projects:

Repository Description Stars
ymcui/chinese-xlnet Provides pre-trained models for Chinese natural language processing tasks using the XLNet architecture 1,652
cluebenchmark/electra Trains and evaluates a Chinese language model using adversarial training on a large corpus. 140
ymcui/macbert Improves pre-trained Chinese language models by incorporating a correction task to alleviate inconsistency issues with downstream tasks 646
ymcui/lert A pre-trained language model designed to leverage linguistic features and outperform comparable baselines on Chinese natural language understanding tasks. 202
ymcui/chinese-mixtral Develops and releases Mixtral-based models for natural language processing tasks with a focus on Chinese text generation and understanding 589
ymcui/chinese-mobilebert An implementation of MobileBERT, a pre-trained language model, in Python for NLP tasks. 81
brightmart/xlnet_zh Trains a large Chinese language model on massive data and provides a pre-trained model for downstream tasks 230
ymcui/pert Develops a pre-trained language model to learn semantic knowledge from permuted text without mask labels 356
yunwentechnology/unilm This project provides pre-trained models and tools for natural language understanding (NLU) and generation (NLG) tasks in Chinese. 439
lemonhu/ner-bert-pytorch A PyTorch implementation of named entity recognition using the Google AI's pre-trained BERT model for Chinese text data. 442
langboat/mengzi Develops lightweight yet powerful pre-trained models for natural language processing tasks 533
lonepatient/nezha_chinese_pytorch An implementation of a Chinese language model using PyTorch and transformer architecture. 262
dbmdz/berts Provides pre-trained language models for natural language processing tasks 155
cluebenchmark/cluepretrainedmodels Provides pre-trained models for Chinese language tasks with improved performance and smaller model sizes compared to existing models. 806
zhuiyitechnology/wobert A Word-based Chinese BERT model trained on large-scale text data using pre-trained models as a foundation 460