vstar

Visual search framework

PyTorch implementation of guided visual search mechanism for multimodal LLMs

PyTorch Implementation of "V* : Guided Visual Search as a Core Mechanism in Multimodal LLMs"

GitHub

541 stars
11 watching
37 forks
Language: Python
last commit: over 2 years ago

Related projects:

RepositoryDescriptionStars
kunpengli1994/vsrnAn open-source PyTorch implementation of a visual semantic reasoning model for image-text matching294
kaiyangzhou/dassl.pytorchA PyTorch toolbox for supporting research and development of domain adaptation, generalization, and semi-supervised learning methods in computer vision.1,236
fartashf/vseppA PyTorch implementation of visual-semantic embedding methods for image-caption retrieval492
hal3/macaricoAn implementation of an imperative learning to search framework in PyTorch for deep learning-based structured prediction and reinforcement learning.111
vpgtrans/vpgtransTransfers visual prompt generators across large language models to reduce training costs and enable customization of multimodal LLMs270
cadene/vqa.pytorchA PyTorch implementation of visual question answering with multimodal representation learning718
volcengine/vescaleA PyTorch-based framework for training large language models in parallel on multiple devices679
vlgiitr/dmn-plusA PyTorch implementation of an improved question answering architecture with dynamic memory networks and attention mechanisms64
leaderj1001/mobilenetv3-pytorchAn implementation of MobileNetV3 using PyTorch with search space optimization292
nexusapoorvacus/deepvariationstructuredrlAn implementation of reinforcement learning for visual relationship and attribute detection using PyTorch.63
jayleicn/clipbertAn efficient framework for end-to-end learning on image-text and video-text tasks709
openseg-group/openseg.pytorchProvides a PyTorch implementation of several computer vision tasks including object detection, segmentation and parsing.1,191
felixgwu/img_classification_pk_pytorchA PyTorch project for comparing image classification models and facilitating quick experiment setup366
clementpinard/sfmlearner-pytorchPytorch implementation of unsupervised depth and ego-motion learning from video sequences1,022
vinhkhuc/pytorch-mini-tutorialsA collection of tutorials and lessons on building deep learning models using the PyTorch library.326