Video-MME
by BradyFU
✨✨Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis
AI summary
Video analysis benchmark
Comprehensive benchmark for evaluating multi-modal large language models on video analysis tasks
- stars
- 422
- forks
- 17
- watching
- 5
Similar projects
Found by comparing what the projects do, not just their names.
Visual Model Benchmark
An open-source benchmarking framework for evaluating cross-style visual capability of large multimodal models
Video benchmarking toolkit
Evaluates and benchmarks large language models' video understanding capabilities
Video understanding optimizer
Develops a method for long video understanding by optimizing memory usage
tsb0601/mmvp296
Visual model evaluation
An evaluation framework for multimodal language models' visual capabilities using image and question benchmarks.
Chinese understanding benchmark
Measures the understanding of massive multitask Chinese datasets using large language models
Video understanding model
This project develops an AI model for long-term video understanding
Real-world challenge simulator
A multimodal large language model benchmark designed to simulate real-world challenges and measure the performance of such models in practical scenarios.
Benchmark
Provides a benchmarking framework for evaluating the quality of text-to-video generation models
Video Analysis Toolkit
A collection of resources and tools for video analysis using deep learning and multi-modal learning techniques.
Multimodal QA Benchmark
A benchmark for evaluating the performance of multimodal question answering models on diverse domains and data types
mltframework/mlt1.5K
Video editor toolkit
A multimedia framework designed for video editing, providing tools and libraries for audio and video processing.
LM Benchmark
A benchmark for evaluating large language models in multiple languages and formats
gabeur/mmt259
Video retriever
Develops a cross-modal architecture for video retrieval by combining multiple types of features from videos and text
Model Evaluator
A benchmarking framework for evaluating Large Multimodal Models by providing rigorous metrics and an efficient evaluation pipeline.
laomao0/bin209
Video interpolator
Software to interpolate blurry video frames and enhance image quality
