Chinese-ELECTRA

Chinese NLP library

Provides pre-trained Chinese language models based on the ELECTRA framework for natural language processing tasks

Pre-trained Chinese ELECTRA(中文ELECTRA预训练模型)

GitHub

1k stars
26 watching
171 forks
Language: Python
last commit: over 1 year ago
bertchinesechinese-electraelectralanguage-modelnlppre-trained-modelpytorchtensorflow

Related projects:

Repository Description Stars
ymcui/chinese-xlnet Provides pre-trained models for Chinese natural language processing tasks using the XLNet architecture 1,653
cluebenchmark/electra Trains and evaluates a Chinese language model using adversarial training on a large corpus. 140
ymcui/macbert Improves pre-trained Chinese language models by incorporating a correction task to alleviate inconsistency issues with downstream tasks 645
ymcui/lert A pre-trained language model designed to leverage linguistic features and outperform comparable baselines on Chinese natural language understanding tasks. 202
ymcui/chinese-mixtral Develops and releases Mixtral-based models for natural language processing tasks with a focus on Chinese text generation and understanding 584
ymcui/chinese-mobilebert An implementation of MobileBERT, a pre-trained language model, in Python for NLP tasks. 80
brightmart/xlnet_zh Trains a large Chinese language model on massive data and provides a pre-trained model for downstream tasks 230
ymcui/pert Develops a pre-trained language model to learn semantic knowledge from permuted text without mask labels 354
yunwentechnology/unilm This project provides pre-trained models for natural language understanding and generation tasks using the UniLM architecture. 438
lemonhu/ner-bert-pytorch A PyTorch implementation of named entity recognition using the Google AI's pre-trained BERT model for Chinese text data. 438
langboat/mengzi Develops lightweight yet powerful pre-trained models for natural language processing tasks 534
lonepatient/nezha_chinese_pytorch An implementation of a Chinese language model using PyTorch and transformer architecture. 262
dbmdz/berts Provides pre-trained language models for natural language processing tasks 155
cluebenchmark/cluepretrainedmodels Provides pre-trained models for Chinese language tasks with improved performance and smaller model sizes compared to existing models. 804
zhuiyitechnology/wobert A pre-trained Chinese language model that uses word embeddings and is designed to process Chinese text 458