finetune-transformer-lm
by openai
Code and model for the paper "Improving Language Understanding by Generative Pre-Training"
AI summary
Language model trainer
This project provides code and model for improving language understanding through generative pre-training using a transformer-based architecture.
- stars
- 2.2K
- forks
- 502
- watching
- 74
Similar projects
Found by comparing what the projects do, not just their names.
language model tuning
Training methods and tools for fine-tuning language models using human preferences
Transformer model
Implementing OpenAI's transformer language model in PyTorch with pre-trained weights and fine-tuning capabilities
Language model training
Trains German transformer models to improve language understanding
Language model trainer
Develops a method for pre-training language understanding models by combining masked and permuted techniques, and provides code for implementation and fine-tuning.
Language model toolkit
Provides pre-trained language models and tools for fine-tuning and evaluation
Transformer model
An implementation of a transformer-based NLP model utilizing gated attention units
Language model toolkit
A guide to using pre-trained large language models in source code analysis and generation
fastnlp/cpt482
Transformer model
A pre-trained transformer model for natural language understanding and generation tasks in Chinese
Language model trainer
A framework for training and fine-tuning multimodal language models on various data types
Language model tuner
A repository providing tools and datasets to fine-tune language models for specific tasks
Transformer trainer
Research tool for training large transformer language models at scale
Deep learning trainer
Provides a flexible and configurable framework for training deep learning models with PyTorch.
Transformer trainer
A collection of tools and scripts for training large transformer language models at scale
Text generator
Develops pretraining and finetuning techniques for language models using metadata-conditioned text generation
LLM
An open-source implementation of a vision-language instructed large language model
