Chinese-BERT-wwm

Chinese language models

Develops and publishes pre-trained Chinese language models using Whole Word Masking technology.

Pre-Training with Whole Word Masking for Chinese BERT(中文BERT-wwm系列模型)

GitHub

10k stars
144 watching
1k forks
Language: Python
last commit: over 1 year ago
bertbert-wwmbert-wwm-extchinese-bertnlppytorchrbtrobertaroberta-wwmtensorflow

Related projects:

Repository Description Stars
fudannlp/fnlp A toolkit for Chinese natural language processing tasks 2,647
huawei-noah/pretrained-language-model A collection of pre-trained language models and optimization techniques for efficient natural language processing 3,028
esbatmop/mnbvc Collects and provides access to a vast corpus of Chinese text data from various sources 3,520
pku-yuangroup/video-llava This project enables large language models to perform visual reasoning capabilities on images and videos simultaneously by learning united visual representations before projection. 2,990
thunlp/plmpapers Compiles and organizes key papers on pre-trained language models, providing a resource for developers and researchers. 3,328
nlintz/tensorflow-tutorials A collection of tutorials teaching deep learning with TensorFlow using Jupyter Notebooks 6,006
google-research/text-to-text-transfer-transformer Provides tools and libraries for training and fine-tuning large language models using transformer architectures 6,181
l1aoxingyu/code-of-learn-deep-learning-with-pytorch Tutorials and code examples for learning deep learning with PyTorch 2,819
tencent/tnn A high-performance neural network inference framework supporting various deep learning frameworks and hardware platforms. 4,415
kimiyoung/transformer-xl Implementations of a neural network architecture for language modeling 3,611
brightmart/text_classification An NLP project offering various text classification models and techniques for deep learning exploration 7,861
ymcui/chinese-xlnet Provides pre-trained models for Chinese natural language processing tasks using the XLNet architecture 1,653
dair-ai/ml-papers-explained An explanation of key concepts and advancements in the field of Machine Learning 7,315
brightmart/roberta_zh Implements RoBERTa for Chinese pre-training using TensorFlow and provides PyTorch versions for loading and training 2,618
tensorspeech/tensorflowtts Real-time speech synthesis using state-of-the-art architectures 3,839