Video-ChatGPT
by mbzuai-oryx
[ACL 2024 🔥] Video-ChatGPT is a video conversation model capable of generating meaningful conversation about videos. It combines the capabilities of LLMs with a pretrained visual encoder adapted for spatiotemporal video representation. We also introduce a rigorous 'Quantitative Evaluation Benchmarking' for video-based conversational models.
AI summary
Video conversational model
A video conversation model that generates meaningful conversations about videos using large vision and language models
- stars
- 1.2K
- forks
- 110
- watching
- 15
Similar projects
Found by comparing what the projects do, not just their names.
Multimodal conversational model
An end-to-end trained model capable of generating natural language responses integrated with object segmentation masks for interactive visual conversations
Chatbot
A conversational language model developed to improve understanding of complex instructions and Chinese vocabulary.
Conversational AI
An advanced language model designed to generate human-like responses in various domains and applications
79e/chatgpt-web1.4K
Conversational app
A commercially viable web application for conversational AI built with React and OpenAI's ChatGPT technology
Conversational AI model
A large language model with 70 billion parameters designed for chatbot and conversational AI tasks
Video understanding model
A large language model designed to understand long videos by binding visual content with timestamps and producing video token sequences of varying lengths.
Conversational AI model
A large language model designed to support long context conversations with improved efficiency and effectiveness
Multimodal Chatbot
Trains a multimodal chatbot that combines visual and language instructions to generate responses
Chatbot
A conversational AI demo powered by a large language model
Model arena
An evaluation platform for comparing multi-modality models on visual question-answering tasks
Conversational bot
A Discord bot that enables interactive conversations with ChatGPT using a single command.
Chatbot
A multimodal chatbot with computer vision capabilities integrated into a single model
Visual Prompt Model
A system designed to enable large multimodal models to understand arbitrary visual prompts
Conversational image interface
An intelligent system that enables automatic control and utilization of visual foundation models to interact with images in conversational settings.
showlab/vlog545
Video doc generator
Transforms video content into a long document containing visual and audio information that can be used for chat or other applications.
