MovieChat
by rese1f
[CVPR 2024] MovieChat: From Dense Token to Sparse Memory for Long Video Understanding
AI summary
Video understanding optimizer
Develops a method for long video understanding by optimizing memory usage
- stars
- 550
- forks
- 41
- watching
- 10
Similar projects
Found by comparing what the projects do, not just their names.
Video understanding model
A large language model designed to understand long videos by binding visual content with timestamps and producing video token sequences of varying lengths.
Video benchmarking toolkit
Evaluates and benchmarks large language models' video understanding capabilities
Video analysis benchmark
Comprehensive benchmark for evaluating multi-modal large language models on video analysis tasks
gabeur/mmt259
Video retriever
Develops a cross-modal architecture for video retrieval by combining multiple types of features from videos and text
Video describer
An artificial intelligence system designed to understand and describe long-form video content
Video image processor
An image-based language model that uses large language models to generate visual and text features from videos
Video editor
A native video editing library for React Native that provides tools for trimming, compressing, and processing videos on mobile devices.
Video Analysis Toolkit
A collection of resources and tools for video analysis using deep learning and multi-modal learning techniques.
Video understanding model
This project develops an AI model for long-term video understanding
Video analyzer
A utility for analyzing videos based on objects and scenes within them
Behavior alignment tool
Aligns large language models' behavior through fine-grained correctional human feedback to improve trustworthiness and accuracy.
Video analysis framework
A collection of video analysis methods and datasets for research and development
Movie QA system
This project explores question-answering in movies using various machine learning approaches.
Movie comparer
A CLI tool for retrieving and comparing movie information
Video detector
An implementation of an end-to-end learning framework for video object detection using feature aggregation along motion paths
