TextBind
by SihengLi99
[2024-ACL]: TextBind: Multi-turn Interleaved Multimodal Instruction-following in the Wildrounded Conversation
AI summary
Conversational AI framework
Enables larger language models to generate multi-turn multimodal instruction-response conversations from image-caption pairs with minimal annotations.
- stars
- 47
- forks
- 3
- watching
- 3
Similar projects
Found by comparing what the projects do, not just their names.
Language model trainer
Develops a method for pre-training language understanding models by combining masked and permuted techniques, and provides code for implementation and fine-tuning.
Multimodal alignment model
Extending pretraining models to handle multiple modalities by aligning language and video representations
Language model trainer
A framework for training and fine-tuning multimodal language models on various data types
Retrieval model trainer
Trains and evaluates a universal multimodal retrieval model to perform various information retrieval tasks.
Vision-Language Learning Model
Develops and trains models for vision-language learning with decoupled language pre-training
Model Training Framework
A framework for collaborative machine learning model training that leverages similarity between model representations to correct local training.
Chart model trainer
Develops a large-scale dataset and benchmark for training multimodal chart understanding models using large language models.
Language model trainer
This project provides code and model for improving language understanding through generative pre-training using a transformer-based architecture.
Instruction model
A collection of multilingual language models trained on a dataset of instructions and responses in various languages.
Webpage-to-code model trainer
A dataset and framework for training large multimodal language models on webpage-to-code generation tasks
Vision-Language Model Trainer
This is an open-source project that proposes a novel method to train large-scale vision-language models with minimal resources and no fine-tuning required.
Model trainer
Develops training methods to improve the politeness and natural flow of multi-modal Large Language Models
Model trainer
A live training platform for large-scale deep learning models, allowing community participation and collaboration in model development and deployment.
Vision language model trainer
An annotated preference dataset and training framework for improving large vision language models.
Deep learning trainer
Provides a flexible and configurable framework for training deep learning models with PyTorch.
