TempCompass
by llyx97
[ACL 2024 Findings] "TempCompass: Do Video LLMs Really Understand Videos?", Yuanxin Liu, Shicheng Li, Yi Liu, Yuxiang Wang, Shuhuai Ren, Lei Li, Sishuo Chen, Xu Sun, Lu Hou
AI summary
Video understanding tester
A tool to evaluate video language models' ability to understand and describe video content
- stars
- 91
- forks
- 2
- watching
- 4
Similar projects
Found by comparing what the projects do, not just their names.
Temporal processor
Develops a video analysis module with efficient temporal processing capabilities
lxtgh/omg-seg1.3K
Visual Model
Develops an end-to-end model for multiple visual perception and reasoning tasks using a single encoder, decoder, and large language model.
Video benchmarking toolkit
Evaluates and benchmarks large language models' video understanding capabilities
Video understanding model
This project develops an AI model for long-term video understanding
Video LLM
A video Large Language Model designed for fine-grained comprehension and localization in videos with a custom Temporal Perception Module for improved temporal modeling
Video understanding model
A large language model designed to understand long videos by binding visual content with timestamps and producing video token sequences of varying lengths.
Text-Video Embedding Toolkit
Provides code and tools for learning joint text-video embeddings using the HowTo100M dataset
Video image processor
An image-based language model that uses large language models to generate visual and text features from videos
LLM Tester
An extension of Vitest for testing LLM applications using local language models
Video inpainting model
Proposes a deep learning model to fill missing regions in video frames and generate completed videos
tsb0601/mmvp296
Visual model evaluation
An evaluation framework for multimodal language models' visual capabilities using image and question benchmarks.
Model Tester
A tool for testing and evaluating large language models with a focus on AI safety and model assessment.
Prompt evaluator
An API for evaluating the quality of text prompts used in Large Language Models (LLMs) based on perplexity estimation
Video Moment LLM
A PyTorch-based Video LLM designed to understand and reason about video moments in terms of time boundaries.
LLM benchmarking tool
A tool for evaluating the performance of large language model APIs
