groundingLMM
by mbzuai-oryx
[CVPR 2024 🔥] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses that are seamlessly integrated with object segmentation masks.
AI summary
Multimodal conversational model
An end-to-end trained model capable of generating natural language responses integrated with object segmentation masks for interactive visual conversations
- stars
- 797
- forks
- 37
- watching
- 31
Similar projects
Found by comparing what the projects do, not just their names.
Edge model
A small language model designed to run efficiently on edge devices with minimal resource requirements.
Multimodal LLM
A multi-modal large language model that integrates natural language and visual capabilities with fine-tuning for various tasks
Multimodal LLM
A multi-modal language model that integrates image, video, audio, and text data to improve language understanding and generation
Video conversational model
A video conversation model that generates meaningful conversations about videos using large vision and language models
openbmb/viscpm1.1K
Multimodal Models
A family of large multimodal models supporting multimodal conversational capabilities and text-to-image generation in multiple languages
Vision-based LLM
An open-source multimodal LLM project with a vision-centric design
Model arena
An evaluation platform for comparing multi-modality models on visual question-answering tasks
Multimodal LLM
An implementation of a multimodal language model with capabilities for comprehension and generation
Instruction model
A collection of multilingual language models trained on a dataset of instructions and responses in various languages.
Multimodal LLM
An open-source multilingual large language model designed to understand and generate content across diverse languages and cultural contexts
Multimodal model framework
A framework for grounding language models to images and handling multimodal inputs and outputs
Image captioner
An end-to-end image captioning system that uses large multi-modal models and provides tools for training, inference, and demo usage.
Multimodal LLM
An LLaMA-based multimodal language model with various instruction-following and multimodal variants.
Multimodal model trainer
An implementation of a multimodal LLM training paradigm to enhance truthfulness and ethics in language models
Multimodal Model Builder
A framework to build versatile Multimodal Large Language Models with synergistic comprehension and creation capabilities
