pytorch-openai-transformer-lm
Transformer model
Implementing OpenAI's transformer language model in PyTorch with pre-trained weights and fine-tuning capabilities
🐥A PyTorch implementation of OpenAI's finetuned transformer language model with a script to import the weights pre-trained by OpenAI
2k stars
92 watching
285 forks
Language: Python
last commit: over 3 years ago language-modelneural-networksopenaipytorchtransformer
Related projects:
| Repository | Description | Stars |
|---|---|---|
 openai/finetune-transformer-lm | This project provides code and model for improving language understanding through generative pre-training using a transformer-based architecture. | 2,160 |
 leviswind/pytorch-transformer | Implementation of a transformer-based translation model in PyTorch | 239 |
 thnkim/openfacepytorch | Converts OpenFace's nn4.small2.v1.t7 model to a PyTorch module for face recognition and feature extraction | 183 |
 lucidrains/reformer-pytorch | An implementation of Reformer, an efficient Transformer model for natural language processing tasks. | 2,120 |
 rdspring1/pytorch_gbw_lm | Trains a large-scale PyTorch language model on the 1-Billion Word dataset | 123 |
 gmalivenko/pytorch2keras | Converts PyTorch models to Keras models | 857 |
| openai/lm-human-preferences | Training methods and tools for fine-tuning language models using human preferences | 1,229 |
| huggingface/torchmoji | An open-source implementation of a deep learning model that analyzes sentiment and emotion in text using emojis | 918 |
 pytorchbearer/torchbearer | A PyTorch model fitting library designed to simplify the process of training deep learning models. | 636 |
 tongjilibo/bert4torch | An implementation of transformer models in PyTorch for natural language processing tasks | 1,241 |
| huggingface/optimum-quanto | A PyTorch quantization backend for models. | 822 |
 l0sg/relational-rnn-pytorch | An implementation of DeepMind's Relational Recurrent Neural Networks (Santoro et al. 2018) in PyTorch for word language modeling | 244 |
 clcarwin/convert_torch_to_pytorch | Converts PyTorch models to their Torch equivalents. | 539 |
| huggingface/tflite-android-transformers | Converts popular transformer models to run on Android devices for efficient inference and generation tasks. | 392 |
| clcarwin/sphereface_pytorch | A PyTorch implementation of the SphereFace face recognition algorithm. | 715 |