PVIT
Repository of paper: Position-Enhanced Visual Instruction Tuning for Multimodal Large Language Models
AI summary
Visual Instruction Model
A project that extends large language models by integrating an additional region-level vision encoder to improve visual instruction tuning.
- stars
- 37
- forks
- 2
- watching
- 2
Similar projects
Found by comparing what the projects do, not just their names.
Visual Instruction Tuning
A dataset and model designed to scale visual instruction tuning using language-only GPT-4 models.
Visual Instruction Toolkit
A method and toolkit for fine-tuning large language models to perform visual instruction tasks in multiple languages.
Instruction dataset
A multimodal benchmark dataset designed to evaluate the performance of vision-language foundation models through instruction tuning.
LLM trainer
Transfers visual prompt generators across large language models to reduce training costs and enable customization of multimodal LLMs
Visual Prompt Model
A system designed to enable large multimodal models to understand arbitrary visual prompts
Visual Instruction Tuning
An open-source project that enhances visual instruction tuning for text-rich image understanding by integrating GPT-4 models with multimodal datasets.
whai362/pvt1.7K
PVT
An implementation of Pyramid Vision Transformers for image classification, object detection, and semantic segmentation tasks
Visual Instructions
A dataset of fine-grained visual instructions generated by prompting a large language model with images from another dataset
Instruction generator
Creating synthetic visual reasoning instructions to improve the performance of large language models on image-related tasks
Vision language model trainer
An annotated preference dataset and training framework for improving large vision language models.
jy0205/lavit544
Visual understanding and generation framework
A unified framework for training large language models to understand and generate visual content
Region-of-Interest Training
Training and deploying large language models on computer vision tasks using region-of-interest inputs
Instruction dataset generator
Autonomously generates high-quality image-text instruction fine-tuning datasets
Video model evaluator
A benchmark suite for evaluating the performance of video generative models
PV simulator
A Python library for simulating photovoltaic energy system performance and modeling solar energy systems.
