MPNet
by microsoft
MPNet: Masked and Permuted Pre-training for Language Understanding https://arxiv.org/pdf/2004.09297.pdf
AI summary
Language model trainer
Develops a method for pre-training language understanding models by combining masked and permuted techniques, and provides code for implementation and fine-tuning.
- stars
- 288
- forks
- 33
- watching
- 13
Similar projects
Found by comparing what the projects do, not just their names.
Language model trainer
This project provides code and model for improving language understanding through generative pre-training using a transformer-based architecture.
Language model trainer
A framework for training and fine-tuning multimodal language models on various data types
Chinese language model
Trains a large Chinese language model on massive data and provides a pre-trained model for downstream tasks
Parallelism framework
A pretraining framework for large language models using 3D parallelism and scalable training techniques
Language Model
An implementation of a neural network model for character-level language modeling.
Multilingual language models
This repository provides pre-trained models and code for understanding and generation tasks in multiple languages.
Model trainer
A live training platform for large-scale deep learning models, allowing community participation and collaboration in model development and deployment.
Language model trainer
A toolkit for training neural network language models
Language model training
Trains German transformer models to improve language understanding
Conversational AI framework
Enables larger language models to generate multi-turn multimodal instruction-response conversations from image-caption pairs with minimal annotations.
Language model toolkit
A guide to using pre-trained large language models in source code analysis and generation
Chinese language models
Provides pre-trained models for Chinese language tasks with improved performance and smaller model sizes compared to existing models.
Language Model
A high-performance language model designed to excel in tasks like natural language understanding, mathematical computation, and code generation
Machine learning trainer
A Python implementation of a distributed machine learning framework for training neural networks on multiple GPUs
Model trainer
Develops training methods to improve the politeness and natural flow of multi-modal Large Language Models
