awesome-image-captioning
by zhjohnchan
A curated list of image captioning and related area resources. :-)
AI summary
Image Captioning Resources
Curated list of resources on image captioning and related areas, including papers, datasets, and implementations.
- stars
- 1.1K
- forks
- 184
- watching
- 40
- awesome list
- 1
- entries
- 193
What's in the list
193 links in 15 sections, with live GitHub stats.activeno commit in 2y
Change Log
here
May 25 An up-to-date paper list about vision-and-language pre-training is available
Papers / Survey
- A Comprehensive Survey of Deep Learning for Image Captioning
Hossain M et al,
Papers / Before
- I2t: Image parsing to text description
Yao B Z et al,
- Im2Text: Describing Images Using 1 Million Captioned Photographs
Ordonez V et al,
Papers / 2015
- Show and Tell: A Neural Image Caption Generator
Vinyals O et al,
- Deep Visual-Semantic Alignments for Generating Image Descriptions
Karpathy A et al,
- Order-Embeddings of Images and Language
Vendrov I et al,
- Generating Images from Captions with Attention
Mansimov E et al,
Papers / 2016
- Image captioning with semantic attention
You Q et al,
- Deep Compositional Captioning: Describing Novel Object Categories without Paired Training Data
Lisa Anne Hendricks et al,
- SPICE: Semantic Propositional Image Caption Evaluation
Anderson P et al,
- Image Captioning with Deep Bidirectional LSTMs
Wang C et al,
- Multimodal Pivots for Image Caption Translation
Hitschler J et al,
- Generating captions without looking beyond objects
Heuer H et al,
Papers / 2017
- Captioning Images with Diverse Objects
Venugopalan S et al,
- Top-down Visual Saliency Guided by Captions
Ramanishka V et al,
- Self-Critical Sequence Training for Image Captioning
Steven J et al,
- Areas of Attention for Image Captioning
Pedersoli M et al,
- Boosting Image Captioning with Attributes
Yao T et al,
- Paying Attention to Descriptions Generated by Image Captioning Models
Tavakoliy H R et al,
- Image Caption with Global-Local Attention
Li L et al,
- Reference Based LSTM for Image Captioning
Chen M et al,
- Attention Correctness in Neural Image Captioning
Liu C et al,
- Text-guided Attention Model for Image Captioning
Mun J et al,
- Contrastive Learning for Image Captioning
Dai B et al,
- Actor-Critic Sequence Training for Image Captioning
Zhang L et al,
Papers / 2018
- Neural Baby Talk
Lu J et al,
- Convolutional Image Captioning
Aneja J et al,
- Learning to Evaluate Image Captioning
Cui Y et al,
- Recurrent Fusion Network for Image Captioning
Jiang W et al,
- Learning to Guide Decoding for Image Captioning
Jiang W et al,
- Partially-Supervised Image Captioning
Anderson P et al,
- Defoiling Foiled Image Captions
Wang J et al,
- Punny Captions: Witty Wordplay in Image Descriptions
Chandrasekaran A et al,
- CNN+CNN: Convolutional Decoders for Image Captioning
Wang Q et al,
- Diverse and Controllable Image Captioning with Part-of-Speech Guidance
Deshpande A et al,
Papers / 2019
- Unsupervised Image Captioning
Yang F et al,
- Engaging Image Captioning Via Personality
Shuster K et al,
- Pointing Novel Objects in Image Captioning
Li Y et al,
- Auto-Encoding Scene Graphs for Image Captioning
Yang X et al,
- Context and Attribute Grounded Dense Captioning
Yin G et al,
- Intention Oriented Image Captions with Guiding Objects
Zheng Y et al,
- Adversarial Semantic Alignment for Improved Image Captions
Dognin P et al,
- Meta Learning for Image Captioning
Li N et al,
- Learning Object Context for Dense Captioning
Li X et al,
- Hierarchical Attention Network for Image Captioning
Wang W et al,
- Image Captioning with Unseen Objects
Demirel et al,
- Hierarchy Parsing for Image Captioning
Yao T et al,
- Entangled Transformer for Image Captioning
Li G et al,
- Attention on Attention for Image Captioning
Huang L et al,
- Image Captioning: Transforming Objects into Words
Herdade S et al,
- Compositional Generalization in Image Captioning
Nikolaus M et al,
Papers / 2020
- Reinforcing an Image Caption Generator using Off-line Human Feedback
Hongsuck Seo P et al,
- Cross-modal Coherence Modeling for Caption Generation
Alikhani M et al,
- Length-Controllable Image Captioning
Deng C et al,
- Captioning Images Taken by People Who Are Blind
Gurari D et al,
- Towards Unique and Informative Captioning of Images
Wang Z et al,
- Learning Visual Representations with Caption Annotations
Sariyildiz M et al,
- CapWAP: Image Captioning with a Purpose
Fisch A et al,
- Diverse Image Captioning with Context-Object Split Latent Spaces
Mahajan S et al,
Dataset
- nocaps
, LANG:
- MS COCO
, LANG:
- Flickr 8k
, LANG:
- Flickr 30k
, LANG:
- AI Challenger
, LANG:
- Visual Genome
, LANG:
- SBUCaptionedPhotoDataset
, LANG:
- IAPR TC-12
, LANG:
Image Captioning Challenge
Popular Implementations / PyTorch
Popular Implementations / TensorFlow
Popular Implementations / Torch
Popular Implementations / Others
Nothing in this list matches your filter.
Featured in 1 awesome list
Each link jumps to the spot where the list mentions awesome-image-captioning.
More related projects
jiasenlu/hiecoattenvqa349
ibm/max-audio-classifier154
ibm/max-image-segmenter32
ibm/max-audio-embedding-generator57
nasa-impact/marine_debris_ml81
ibm/max-object-detector290
kinhong/openlabeler114
yuyang-huang/keras-inception-resnet-v2180
ibm/max-image-caption-generator84
ibm/max-news-text-generator26
ibm/max-word-embedding-generator9
tensorflow/tfjs-models14.2K
bharatsingh430/py-r-fcn-multigpu193
oandrienko/fast-semantic-segmentation220