HieCoAttenVQA

Visual QA framework

A framework for training Hierarchical Co-Attention models for Visual Question Answering using preprocessed data and a specific image model.

GitHub

349 stars
15 watching
123 forks
Language: Jupyter Notebook
last commit: almost 8 years ago
Linked from 2 awesome lists


Backlinks from these awesome lists:

Related projects:

RepositoryDescriptionStars
akirafukui/vqa-mcbA software framework for training and deploying multimodal visual question answering models using compact bilinear pooling.222
visionlearninggroup/ask_attend_and_answerDevelops a deep learning model to answer questions about visual scenes based on spatial attention and question guidance25
jnhwkim/nips-mrn-vqaThis project presents a neural network model designed to answer visual questions by combining question and image features in a residual learning framework.39
hengyuan-hu/bottom-up-attention-vqaAn implementation of a VQA system using bottom-up attention, aiming to improve the efficiency and speed of visual question answering tasks.755
zcyang/imageqa-sanThis project provides code for training image question answering models using stacked attention networks and convolutional neural networks.108
yj-yu/lsmdcA framework implementing a joint sequence fusion model for video question answering and retrieval31
cadene/vqa.pytorchA PyTorch implementation of visual question answering with multimodal representation learning718
hyeonwoonoh/vqa-transfer-externaldataTools and scripts for training and evaluating a visual question answering model using transfer learning from an external data source.20
gt-vision-lab/vqa_lstm_cnnA Visual Question Answering model using a deeper LSTM and normalized CNN architecture.377
jy0205/lavitA unified framework for training large language models to understand and generate visual content544
milvlg/prophetAn implementation of a two-stage framework designed to prompt large language models with answer heuristics for knowledge-based visual question answering tasks.270
jiasenlu/adaptiveattentionAdaptive attention mechanism for image captioning using visual sentinels335
qt/qtdeclarativeA comprehensive collection of libraries and modules for building user interfaces and dynamic applications using Qt's declarative language.231
nvlabs/relvitA deep learning framework designed to improve visual reasoning capabilities by utilizing concepts and semantic relations.64
findalexli/scigraphqaA dataset and benchmarking framework for evaluating the performance of large language models on multi-turn question answering tasks for scientific graphs.38