lens
by ContextualAI
This is the official repository for the LENS (Large Language Models Enhanced to See) system.
AI summary
Image captioner
Enhances language models to generate text based on visual descriptions of images
- stars
- 352
- forks
- 12
- watching
- 9
Similar projects
Found by comparing what the projects do, not just their names.
Image Captioning Model
Adaptive attention mechanism for image captioning using visual sentinels
Image captioning model
A deep learning model for generating image captions with semantic attention
Image Captioner
A project for pre-training models to support image captioning and question answering tasks.
Caption generator
Trains image paragraph captioning models to generate diverse and accurate captions
Text generator
Enables automatic generation of descriptive text from images and videos based on user input.
Image captioner
An unsupervised image captioning framework that allows generating captions from images without paired data.
Image captioning model
An image caption generation model that uses abstract scene graphs to fine-grained control and generate captions
Caption rewriting
Automates the process of generating multiple rewritten image captions by fine-tuning large vision-language models
Image captioning method
An approach to image captioning that leverages the CLIP model and fine-tunes a language model without requiring additional supervision or object annotation.
Vision Language Integrator
Improves performance of vision language tasks by integrating computer vision capabilities into large language models
ML image recognition model
An implementation of a multimodal learning approach to improve language models' ability to recognize unseen images and understand novel concepts.
Hallucination mitigation
This project provides an official PyTorch implementation of a method to interpret and edit vision-language representations to mitigate hallucinations in image captions.
UI library
A React UI component library designed to be simple and customizable
Lenses library
A lightweight alternative to the lens library with fewer dependencies and no Template Haskell support
Coloring book
An online coloring book with interactive features
