InternVideo
by OpenGVLab
[ECCV2024] Video Foundation Models & Data for Multimodal Understanding
AI summary
Video foundation models
Develops general video foundation models and related datasets for multimodal understanding and generation through generative and discriminative learning.
- stars
- 1.5K
- forks
- 91
- watching
- 27
- #action-recognition
- #benchmark
- #contrastive-learning
- #foundation-models
- #instruction-tuning
- #masked-autoencoder
- #multimodal
- #open-set-recognition
- #self-supervised
- #spatio-temporal-action-localization
- #temporal-action-localization
- #video-clip
- #video-data
- #video-dataset
- #video-question-answering
- #video-retrieval
- #video-understanding
- #vision-transformer
- #zero-shot-classification
- #zero-shot-retrieval
Similar projects
Found by comparing what the projects do, not just their names.
Video analysis framework
A collection of video analysis methods and datasets for research and development
Video benchmarking toolkit
Evaluates and benchmarks large language models' video understanding capabilities
FFmpeg tutorial repository
A collection of resources and tutorials on using FFmpeg for video processing and playback
Video retrieval framework
Develops a deep learning framework for video retrieval using text and computer vision
Computer Vision Library
A collection of computer vision methods for solving geometric vision problems
Visual decoder
A large language model designed to process and generate visual information
Video image processor
An image-based language model that uses large language models to generate visual and text features from videos
Video reconstruction library
Reconstructs high-quality video frames from two adjacent rolling shutter camera frames
nvlabs/edm1.4K
Generative model framework
This project provides a set of tools and techniques to design and improve diffusion-based generative models.
Data comprehension tool
A research project that develops tools and models for understanding visual data in the open world, enabling applications such as image-text retrieval and relation comprehension.
showlab/vlog545
Video doc generator
Transforms video content into a long document containing visual and audio information that can be used for chat or other applications.
Video camera library
A software library for video acquisition and processing using Genicam cameras.
Video search system
A deep learning-based video search system using pre-trained models and datasets
Video processing library
FFmpeg packaged for Zig
