xlnet
by zihangdai
XLNet: Generalized Autoregressive Pretraining for Language Understanding
AI summary
Language model framework
A deep learning framework for unsupervised language representation learning and natural language processing tasks using a generalized autoregressive pretraining method.
- stars
- 6.2K
- forks
- 1.2K
- watching
- 170
Similar projects
Found by comparing what the projects do, not just their names.
Chinese language model
Trains a large Chinese language model on massive data and provides a pre-trained model for downstream tasks
Chinese NLP Models
Provides pre-trained models for Chinese natural language processing tasks using the XLNet architecture
NLP toolkit
An NLP project offering various text classification models and techniques for deep learning exploration
Language models
A collection of pre-trained language models and optimization techniques for efficient natural language processing
aksnzhy/xlearn3.1K
Machine Learning Library
A high-performance machine learning package with linear models and factorization machines.
ML explanations
An explanation of key concepts and advancements in the field of Machine Learning
thunlp/plmpapers3.3K
Language model research paper collection
Compiles and organizes key papers on pre-trained language models, providing a resource for developers and researchers.
Language model backend
Implementations of a neural network architecture for language modeling
openai/gpt-222.6K
Language model repository
A repository providing code and models for research into language modeling and multitask learning
Datasets
A curated collection of high-quality datasets for training large language models.
BERT model
An implementation of Google's 2018 BERT model in PyTorch, allowing pre-training and fine-tuning for natural language processing tasks
Language model trainer
Develops a method for pre-training language understanding models by combining masked and permuted techniques, and provides code for implementation and fine-tuning.
Prompt engineering guide
Guides software developers on how to effectively use and build systems around Large Language Models like GPT-4.
thudm/glm3.2K
Language Model
A general-purpose language model pre-trained with an autoregressive blank-filling objective and designed for various natural language understanding and generation tasks.
AutoML framework
An automated machine learning framework that learns to ensemble sub-networks to improve model quality
