CPT
Transformer model
A pre-trained transformer model for natural language understanding and generation tasks in Chinese
CPT: A Pre-Trained Unbalanced Transformer for Both Chinese Language Understanding and Generation
481 stars
5 watching
72 forks
Language: Python
last commit: almost 2 years ago chineselanguage-understandingpretrained-modelsptmstext-generationtransformer-architecture
Related projects:
| Repository | Description | Stars |
|---|---|---|
 thudm/chinese-transformer-xl | A pre-trained Chinese language model based on the Transformer-XL architecture. | 218 |
 german-nlp-group/german-transformer-training | Trains German transformer models to improve language understanding | 23 |
 openai/finetune-transformer-lm | This project provides code and model for improving language understanding through generative pre-training using a transformer-based architecture. | 2,160 |
 tongjilibo/bert4torch | An implementation of transformer models in PyTorch for natural language processing tasks | 1,241 |
 brightmart/xlnet_zh | Trains a large Chinese language model on massive data and provides a pre-trained model for downstream tasks | 230 |
 microsoft/megatron-deepspeed | Research tool for training large transformer language models at scale | 1,895 |
 bigscience-workshop/megatron-deepspeed | A collection of tools and scripts for training large transformer language models at scale | 1,335 |
 zhuiyitechnology/gau-alpha | An implementation of a Gated Attention Unit-based Transformer model for natural language processing tasks | 96 |
 matlab-deep-learning/transformer-models | An implementation of deep learning transformer models in MATLAB | 206 |
 jsksxs360/how-to-use-transformers | A comprehensive guide to using the Transformers library for natural language processing tasks | 1,133 |
 chrislemke/sk-transformers | Provides a collection of reusable data transformation tools | 8 |
 lucidrains/reformer-pytorch | An implementation of Reformer, an efficient Transformer model for natural language processing tasks. | 2,120 |
 leviswind/pytorch-transformer | Implementation of a transformer-based translation model in PyTorch | 239 |
 huggingface/pytorch-openai-transformer-lm | Implementing OpenAI's transformer language model in PyTorch with pre-trained weights and fine-tuning capabilities | 1,511 |
 yunwentechnology/unilm | This project provides pre-trained models for natural language understanding and generation tasks using the UniLM architecture. | 438 |