Chinese-BERT-wwm

Chinese language models

Develops and publishes pre-trained Chinese language models using Whole Word Masking technology.

Pre-Training with Whole Word Masking for Chinese BERT(中文BERT-wwm系列模型)

GitHub

10k stars
143 watching
1k forks
Language: Python
last commit: over 1 year ago
bertbert-wwmbert-wwm-extchinese-bertnlppytorchrbtrobertaroberta-wwmtensorflow

Related projects:

Repository Description Stars
fudannlp/fnlp A toolkit for Chinese natural language processing tasks 2,648
huawei-noah/pretrained-language-model A collection of pre-trained language models and optimization techniques for efficient natural language processing 3,039
esbatmop/mnbvc A massive corpus of Chinese text data covering various forms and styles 3,581
pku-yuangroup/video-llava A deep learning framework for generating videos from text inputs and visual features. 3,071
thunlp/plmpapers Compiles and organizes key papers on pre-trained language models, providing a resource for developers and researchers. 3,331
nlintz/tensorflow-tutorials A collection of tutorials teaching deep learning with TensorFlow using Jupyter Notebooks 6,003
google-research/text-to-text-transfer-transformer Provides tools and libraries for training and fine-tuning large language models using transformer architectures 6,215
l1aoxingyu/code-of-learn-deep-learning-with-pytorch Tutorials and code examples for learning deep learning with PyTorch 2,822
tencent/tnn A high-performance neural network inference framework supporting various deep learning frameworks and hardware platforms. 4,435
kimiyoung/transformer-xl Implementations of a neural network architecture for language modeling 3,619
brightmart/text_classification An NLP project offering various text classification models and techniques for deep learning exploration 7,881
ymcui/chinese-xlnet Provides pre-trained models for Chinese natural language processing tasks using the XLNet architecture 1,652
dair-ai/ml-papers-explained An explanation of key concepts and advancements in the field of Machine Learning 7,352
brightmart/roberta_zh Implements RoBERTa for Chinese pre-training using TensorFlow and provides PyTorch versions for loading and training 2,638
tensorspeech/tensorflowtts Real-time speech synthesis using state-of-the-art architectures 3,855