ComVint
by RUCAIBox
The official GitHub page for ''What Makes for Good Visual Instructions? Synthesizing Complex Visual Reasoning Instructions for Visual Instruction Tuning''
AI summary
Instruction generator
Creating synthetic visual reasoning instructions to improve the performance of large language models on image-related tasks
- stars
- 18
- forks
- 0
- watching
- 2
Similar projects
Found by comparing what the projects do, not just their names.
Visual guidance
This project presents a new approach to fine-grained visual understanding using pixel-wise mask regions in language instructions
Instruction dataset generator
Autonomously generates high-quality image-text instruction fine-tuning datasets
rowanz/r2c466
Visual Reasoning Model
An open-source project providing PyTorch code and data for a deep learning model that enables visual commonsense reasoning.
Visual reasoning engine
A framework for training multi-modal language models with a focus on visual inputs and providing interpretable thoughts.
Visual Instruction Tuning
An open-source project that enhances visual instruction tuning for text-rich image understanding by integrating GPT-4 models with multimodal datasets.
Art generator
Automates large batches of AI-generated artwork locally using GPU acceleration.
Visual Instruction Tuning
A dataset and model designed to scale visual instruction tuning using language-only GPT-4 models.
Object detector
An evaluation framework for detecting object hallucinations in vision-language models
Visual matcher
An open-source PyTorch implementation of a visual semantic reasoning model for image-text matching
Visual Instruction Toolkit
A method and toolkit for fine-tuning large language models to perform visual instruction tasks in multiple languages.
Word embeddings
Multi-sense word embeddings learned from visual cooccurrences
Style checker
Analyzes Ruby code for style and syntax errors in RSpec files
lxtgh/omg-seg1.3K
Visual Model
Develops an end-to-end model for multiple visual perception and reasoning tasks using a single encoder, decoder, and large language model.
Caption generator
A PyTorch implementation of a framework for generating captions with styles for images and videos.
Visual code generator
Generates code in a visual programming language using images as input
