vstar
by penghao-wu
PyTorch Implementation of "V* : Guided Visual Search as a Core Mechanism in Multimodal LLMs"
AI summary
Visual search framework
PyTorch implementation of guided visual search mechanism for multimodal LLMs
- stars
- 541
- forks
- 37
- watching
- 11
Similar projects
Found by comparing what the projects do, not just their names.
Visual matcher
An open-source PyTorch implementation of a visual semantic reasoning model for image-text matching
Computer Vision Toolkit
A PyTorch toolbox for supporting research and development of domain adaptation, generalization, and semi-supervised learning methods in computer vision.
ImageCaptionRetrieval
A PyTorch implementation of visual-semantic embedding methods for image-caption retrieval
Learning search engine
An implementation of an imperative learning to search framework in PyTorch for deep learning-based structured prediction and reinforcement learning.
LLM trainer
Transfers visual prompt generators across large language models to reduce training costs and enable customization of multimodal LLMs
VQA model
A PyTorch implementation of visual question answering with multimodal representation learning
LLM trainer
A PyTorch-based framework for training large language models in parallel on multiple devices
QNA architecture
A PyTorch implementation of an improved question answering architecture with dynamic memory networks and attention mechanisms
MobileNetV3 optimizer
An implementation of MobileNetV3 using PyTorch with search space optimization
Visual detection model
An implementation of reinforcement learning for visual relationship and attribute detection using PyTorch.
Video-language model
An efficient framework for end-to-end learning on image-text and video-text tasks
CV library
Provides a PyTorch implementation of several computer vision tasks including object detection, segmentation and parsing.
Image classifier
A PyTorch project for comparing image classification models and facilitating quick experiment setup
Video learning library
Pytorch implementation of unsupervised depth and ego-motion learning from video sequences
PyTorch tutorials
A collection of tutorials and lessons on building deep learning models using the PyTorch library.