guwenbert

Chinese Model

Pre-trained language model for classical Chinese texts using RoBERTa architecture

GuwenBERT: 古文预训练语言模型(古文BERT) A Pre-trained Language Model for Classical Chinese (Literary Chinese)

GitHub

511 stars
6 watching
38 forks
last commit: about 5 years ago
bertclassical-chineseguwenbertliterary-chinesetransformers

Related projects:

RepositoryDescriptionStars
zhuiyitechnology/wobertA Word-based Chinese BERT model trained on large-scale text data using pre-trained models as a foundation460
ymcui/macbertImproves pre-trained Chinese language models by incorporating a correction task to alleviate inconsistency issues with downstream tasks646
turkunlp/wikibertProvides pre-trained language models derived from Wikipedia texts for natural language processing tasks34
yunwentechnology/unilmThis project provides pre-trained models and tools for natural language understanding (NLU) and generation (NLG) tasks in Chinese.439
shannonai/chinesebertA deep learning model that incorporates visual and phonetic features of Chinese characters to improve its ability to understand Chinese language nuances545
cluebenchmark/electraTrains and evaluates a Chinese language model using adversarial training on a large corpus.140
sww9370/rocbertA pre-trained Chinese language model designed to be robust against maliciously crafted texts15
naver/biobert-pretrainedProvides pre-trained weights for a biomedical language representation model672
ieit-yuan/yuan2.0-m32A high-performance language model designed to excel in tasks like natural language understanding, mathematical computation, and code generation182
brightmart/xlnet_zhTrains a large Chinese language model on massive data and provides a pre-trained model for downstream tasks230
cluebenchmark/cluepretrainedmodelsProvides pre-trained models for Chinese language tasks with improved performance and smaller model sizes compared to existing models.806
zhuiyitechnology/pretrained-modelsA collection of pre-trained language models for natural language processing tasks989
zhuiyitechnology/gau-alphaAn implementation of a transformer-based NLP model utilizing gated attention units98
allenai/scibertA BERT model trained on scientific text for natural language processing tasks1,532
skyworkaigc/skytext-chinese-gpt3An AI-powered text generation model trained on Chinese data to perform various tasks such as conversation, translation, and content creation.418