prismer
by NVlabs
The implementation of "Prismer: A Vision-Language Model with Multi-Task Experts".
AI summary
Vision-Language Model
A deep learning framework for training multi-modal models with vision and language capabilities.
- stars
- 1.3K
- forks
- 74
- watching
- 16
Similar projects
Found by comparing what the projects do, not just their names.
Vision-Language Model
A multimodal AI model that enables real-world vision-language understanding applications
Vision-Language Model Framework
Implementing a unified modal learning framework for generative vision-language models
Vision-Language Model
A PyTorch implementation of an encoder-free vision-language model that can be fine-tuned for various tasks and modalities
Multimodal model builder
Develops high-resolution multimodal LLMs by combining vision encoders and various input resolutions
Visual decoder
A large language model designed to process and generate visual information
Vision Language Model
An implementation of a vision language model designed for mobile devices, utilizing a lightweight downsample projector and pre-trained language models.
Image segmentation tool
A system that uses large language models to generate segmentation masks for images based on complex queries and world knowledge.
Vision-Language Learning Model
Develops and trains models for vision-language learning with decoupled language pre-training
Visual encoder
A vision-language model that uses a query transformer to encode images as visual tokens and allows flexible choice of the number of visual tokens.
Vision language model trainer
An annotated preference dataset and training framework for improving large vision language models.
Vision Language Model
Develops a PyTorch implementation of an enhanced vision language model
Multimodal evaluation framework
Develops a multimodal task and dataset to assess vision-language models' ability to handle interleaved image-text inputs.
Video image processor
An image-based language model that uses large language models to generate visual and text features from videos
Image understanding model
A large multi-modal model developed using the Llama3 language model, designed to improve image understanding capabilities.
Vision-Language Model Trainer
This is an open-source project that proposes a novel method to train large-scale vision-language models with minimal resources and no fine-tuning required.
