LERT
by ymcui
LERT: A Linguistically-motivated Pre-trained Language Model（语言学信息增强的预训练模型LERT）
AI summary
Linguistic Model
A pre-trained language model designed to leverage linguistic features and outperform comparable baselines on Chinese natural language understanding tasks.
- stars
- 202
- forks
- 15
- watching
- 3
Similar projects
Found by comparing what the projects do, not just their names.
Semantic learning model
Develops a pre-trained language model to learn semantic knowledge from permuted text without mask labels
Chinese language model fine-tuning tool
Improves pre-trained Chinese language models by incorporating a correction task to alleviate inconsistency issues with downstream tasks
Chinese NLP Models
Provides pre-trained models for Chinese natural language processing tasks using the XLNet architecture
Language Model
A high-performance language model designed to excel in tasks like natural language understanding, mathematical computation, and code generation
MobileBERT model
An implementation of MobileBERT, a pre-trained language model, in Python for NLP tasks.
Chinese NLP library
Provides pre-trained Chinese language models based on the ELECTRA framework for natural language processing tasks
Chinese language model
Trains a large Chinese language model on massive data and provides a pre-trained model for downstream tasks
NLP toolkit
A collection of pre-trained language models for natural language processing tasks
Mixtral model developer
Develops and releases Mixtral-based models for natural language processing tasks with a focus on Chinese text generation and understanding
Chinese NLU/NGL toolkit
This project provides pre-trained models and tools for natural language understanding (NLU) and generation (NLG) tasks in Chinese.
Language Model
A lightweight, multilingual language model with a long context length
Chinese model
A pre-trained Chinese language model with a modest parameter count, designed to be accessible and useful for researchers with limited computing resources.
Language model toolkit
A guide to using pre-trained large language models in source code analysis and generation
Audio Model
An audio and speech large language model implementation with pre-trained models, datasets, and inference options
Word-based Chinese Model
A Word-based Chinese BERT model trained on large-scale text data using pre-trained models as a foundation
