visprog
by allenai
Official code for VisProg (CVPR 2023 Best Paper!)
AI summary
Visual task solver
A system that uses code generation and execution to solve complex visual tasks from natural language instructions.
- stars
- 697
- forks
- 65
- watching
- 15
Similar projects
Found by comparing what the projects do, not just their names.
Virtual lab
An open-source platform for simulating complex interactions between agents and virtual environments.
Task solver
An open-source framework for augmenting large language models with tools by searching on graphs to solve complex real-world tasks.
Visual matcher
An open-source PyTorch implementation of a visual semantic reasoning model for image-text matching
Instruction dataset generator
Autonomously generates high-quality image-text instruction fine-tuning datasets
autoviml/autoviz1.7K
Data visualization tool
Automatically generates insightful visualizations from datasets of any size with minimal code
Visual representation generator
A project that generates visual representations tailored for general visual reasoning, leveraging hierarchical scene descriptions and instance-level world knowledge.
VQA prompter
An implementation of a two-stage framework designed to prompt large language models with answer heuristics for knowledge-based visual question answering tasks.
Visual Instruction Toolkit
A method and toolkit for fine-tuning large language models to perform visual instruction tasks in multiple languages.
lxtgh/omg-seg1.3K
Visual Model
Develops an end-to-end model for multiple visual perception and reasoning tasks using a single encoder, decoder, and large language model.
Vehicle routing solver
A Matlab implementation of simulated annealing to solve the vehicle routing problem with multiple vehicles and constraints.
Visual search framework
PyTorch implementation of guided visual search mechanism for multimodal LLMs
Task manager
A plugin that integrates task management with VS Code's Editor Tasks functionality
cormanz/smartgpt1.8K
Task solver
Provides an LLM with the ability to complete complex tasks by breaking them down into smaller problems and collecting information from external sources.
Visual programming tool
An early prototype of a visual programming language designed to assemble executable Swift code using touch or Apple Pencil input
Visual encoder
A vision-language model that uses a query transformer to encode images as visual tokens and allows flexible choice of the number of visual tokens.
