CLIP_prefix_caption

Image captioning method

An approach to image captioning that leverages the CLIP model and fine-tunes a language model without requiring additional supervision or object annotation.

Simple image captioning model

GitHub

1k stars
7 watching
220 forks
Language: Jupyter Notebook
last commit: over 2 years ago

Related projects:

RepositoryDescriptionStars
chapternewscu/image-captioning-with-semantic-attentionA deep learning model for generating image captions with semantic attention51
fengyang0317/unsupervised_captioningAn unsupervised image captioning framework that allows generating captions from images without paired data.215
luoweizhou/vlpA project for pre-training models to support image captioning and question answering tasks.416
apple2373/chainer-captionAn image caption generation system using a neural network architecture with pre-trained models.64
lukemelas/image-paragraph-captioningTrains image paragraph captioning models to generate diverse and accurate captions90
contextualai/lensEnhances language models to generate text based on visual descriptions of images352
deeprnn/image_captioningThis implementation allows users to generate captions from images using a neural network model with visual attention.790
lumingyin/quickcaptionAutomated captioning and transcription tool for video and audio files74
anonymousanoy/foheAutomates the process of generating multiple rewritten image captions by fine-tuning large vision-language models8
cshizhe/asg2capAn image caption generation model that uses abstract scene graphs to fine-grained control and generate captions200
kdexd/virtexA pretraining approach that uses semantically dense captions to learn visual representations and improve image understanding tasks.556
ruotianluo/imagecaptioning.pytorchA Python-based framework for training and testing image captioning models using PyTorch.1,458
ibm/max-image-caption-generatorAn image caption generation system utilizing machine learning models and deep neural networks.84
kacky24/stylenetA PyTorch implementation of a framework for generating captions with styles for images and videos.63
yiwuzhong/sub-gcA PyTorch implementation of image captioning models via scene graph decomposition.96