MultiInstruct
by VT-NLP
MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuning
AI summary
Instruction dataset
A multimodal benchmark dataset designed to evaluate the performance of vision-language foundation models through instruction tuning.
- stars
- 134
- forks
- 5
- watching
- 7
Similar projects
Found by comparing what the projects do, not just their names.
Instruction dataset
A collection of diverse instruction corpora for improving the development and tuning of Chinese Language Models
Visual Instructions
A dataset of fine-grained visual instructions generated by prompting a large language model with images from another dataset
Visual Instruction Model
A project that extends large language models by integrating an additional region-level vision encoder to improve visual instruction tuning.
Visual Instruction Tuning
An open-source project that enhances visual instruction tuning for text-rich image understanding by integrating GPT-4 models with multimodal datasets.
Instruction model
A collection of multilingual language models trained on a dataset of instructions and responses in various languages.
Instruction dataset generator
Autonomously generates high-quality image-text instruction fine-tuning datasets
Instruction dataset
A collection of automatically generated instructions for training language models.
Instruction Dataset
Creating a large-scale user-based instruction dataset for natural language processing research and development
Visual Instruction Tuning
A dataset and model designed to scale visual instruction tuning using language-only GPT-4 models.
MolDataset
A dataset and tools package designed to support the training and evaluation of large language models for molecular biology tasks
Speech dataset
A collection of acoustic and phonetic speech data designed for training and evaluating automatic speech recognition systems
Medical NLP training data
A large-scale instruction-tuning dataset for multi-task and few-shot learning in the medical domain
Instruction Parser
A large language model designed to understand and generate instructions with accompanying visual content
Instruction generator
Creating synthetic visual reasoning instructions to improve the performance of large language models on image-related tasks
Visual Instruction Toolkit
A method and toolkit for fine-tuning large language models to perform visual instruction tasks in multiple languages.