CPT
Transformer model
A pre-trained transformer model for natural language understanding and generation tasks in Chinese
CPT: A Pre-Trained Unbalanced Transformer for Both Chinese Language Understanding and Generation
482 stars
5 watching
73 forks
Language: Python
last commit: about 2 years ago chineselanguage-understandingpretrained-modelsptmstext-generationtransformer-architecture
Related projects:
| Repository | Description | Stars |
|---|---|---|
 thudm/chinese-transformer-xl | A pre-trained Chinese language model based on the Transformer-XL architecture. | 218 |
 german-nlp-group/german-transformer-training | Trains German transformer models to improve language understanding | 23 |
 openai/finetune-transformer-lm | This project provides code and model for improving language understanding through generative pre-training using a transformer-based architecture. | 2,167 |
 tongjilibo/bert4torch | An implementation of transformer models in PyTorch for natural language processing tasks | 1,257 |
 brightmart/xlnet_zh | Trains a large Chinese language model on massive data and provides a pre-trained model for downstream tasks | 230 |
 microsoft/megatron-deepspeed | Research tool for training large transformer language models at scale | 1,926 |
 bigscience-workshop/megatron-deepspeed | A collection of tools and scripts for training large transformer language models at scale | 1,342 |
 zhuiyitechnology/gau-alpha | An implementation of a transformer-based NLP model utilizing gated attention units | 98 |
 matlab-deep-learning/transformer-models | An implementation of deep learning transformer models in MATLAB | 209 |
 jsksxs360/how-to-use-transformers | A comprehensive guide to using the Transformers library for natural language processing tasks | 1,220 |
 chrislemke/sk-transformers | Provides a collection of reusable data transformation tools | 10 |
 lucidrains/reformer-pytorch | An implementation of Reformer, an efficient Transformer model for natural language processing tasks. | 2,132 |
 leviswind/pytorch-transformer | Implementation of a transformer-based translation model in PyTorch | 240 |
 huggingface/pytorch-openai-transformer-lm | Implementing OpenAI's transformer language model in PyTorch with pre-trained weights and fine-tuning capabilities | 1,511 |
 yunwentechnology/unilm | This project provides pre-trained models and tools for natural language understanding (NLU) and generation (NLG) tasks in Chinese. | 439 |