VideoLLaMA2
by DAMO-NLP-SG
VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMs
AI summary
Video processor
An audio-visual language model designed to advance spatial-temporal modeling and audio understanding in video processing.
- stars
- 957
- forks
- 62
- watching
- 11
Similar projects
Found by comparing what the projects do, not just their names.
showlab/vlog545
Video doc generator
Transforms video content into a long document containing visual and audio information that can be used for chat or other applications.
Video generator
Converts music represented by a GNU LilyPond file into a video containing a horizontally scrolling music staff synchronized with audio rendering.
Video image processor
An image-based language model that uses large language models to generate visual and text features from videos
Video LLM
A video Large Language Model designed for fine-grained comprehension and localization in videos with a custom Temporal Perception Module for improved temporal modeling
Video generator library
This project enables text-to-video generation using a combination of pixel and latent diffusion models.
LLM repository
A collection of information about various large language models used in natural language processing
Video conversational model
A video conversation model that generates meaningful conversations about videos using large vision and language models
LLM trainer
Transfers visual prompt generators across large language models to reduce training costs and enable customization of multimodal LLMs
Video generator
An implementation of a deep learning model to generate videos with dynamic scenes
Video generator library
A comprehensive toolkit for high-performance video generation and processing
Video Assistant
An offline video assistant system powered by large language models and computer vision techniques.
lxtgh/omg-seg1.3K
Visual Model
Develops an end-to-end model for multiple visual perception and reasoning tasks using a single encoder, decoder, and large language model.
Video understanding model
This project develops an AI model for long-term video understanding
Video generator
Unofficial implementation of a deep learning model to generate or modify video content
LLM dataset generator
A command-line interface to generate textual datasets with Large Language Models
