PERT
by ymcui
PERT: Pre-training BERT with Permuted Language Model
AI summary
Semantic learning model
Develops a pre-trained language model to learn semantic knowledge from permuted text without mask labels
- stars
- 356
- forks
- 24
- watching
- 7
Similar projects
Found by comparing what the projects do, not just their names.
Chinese language model fine-tuning tool
Improves pre-trained Chinese language models by incorporating a correction task to alleviate inconsistency issues with downstream tasks
Linguistic Model
A pre-trained language model designed to leverage linguistic features and outperform comparable baselines on Chinese natural language understanding tasks.
Chinese language model
Trains a large Chinese language model on massive data and provides a pre-trained model for downstream tasks
NLP model library
Develops lightweight yet powerful pre-trained models for natural language processing tasks
NLP toolkit
A collection of pre-trained language models for natural language processing tasks
Token representation refinement
Improves pre-trained language models by encouraging an isotropic and discriminative distribution of token representations.
Chinese NLP library
Provides pre-trained Chinese language models based on the ELECTRA framework for natural language processing tasks
Chinese NLP Models
Provides pre-trained models for Chinese natural language processing tasks using the XLNet architecture
Word-based Chinese Model
A Word-based Chinese BERT model trained on large-scale text data using pre-trained models as a foundation
dbmdz/berts155
NLP library
Provides pre-trained language models for natural language processing tasks
Vision-Language Learning Model
Develops and trains models for vision-language learning with decoupled language pre-training
Mixtral model developer
Develops and releases Mixtral-based models for natural language processing tasks with a focus on Chinese text generation and understanding
Language model library
Provides pre-trained language models derived from Wikipedia texts for natural language processing tasks
Chinese language models
Provides pre-trained models for Chinese language tasks with improved performance and smaller model sizes compared to existing models.
MobileBERT model
An implementation of MobileBERT, a pre-trained language model, in Python for NLP tasks.
