TimeChat
[CVPR 2024] TimeChat: A Time-sensitive Multimodal Large Language Model for Long Video Understanding
AI summary
Video understanding model
A large language model designed to understand long videos by binding visual content with timestamps and producing video token sequences of varying lengths.
- stars
- 314
- forks
- 26
- watching
- 5
Similar projects
Found by comparing what the projects do, not just their names.
Video understanding optimizer
Develops a method for long video understanding by optimizing memory usage
Video benchmarking toolkit
Evaluates and benchmarks large language models' video understanding capabilities
Video conversational model
A video conversation model that generates meaningful conversations about videos using large vision and language models
Audio Model
An audio and speech large language model implementation with pre-trained models, datasets, and inference options
Video understanding tester
A tool to evaluate video language models' ability to understand and describe video content
Video processor
A web-based video processing tool that uses AI to facilitate cultural and linguistic tasks such as transcription, translation, and audio synthesis.
Video interpolation model
A deep learning model that jointly performs video frame interpolation and deblurring with unknown exposure time
Video understanding model
This project develops an AI model for long-term video understanding
Conversational AI model
A large language model with 70 billion parameters designed for chatbot and conversational AI tasks
Chinese Dialogue Model
A large-scale pre-trained dialogue model for Chinese language
Chat Model
An English-Chinese chat model developed from a large language model for conversational AI
Benchmark
Provides a benchmarking framework for evaluating the quality of text-to-video generation models
Chinese NLU/NGL toolkit
This project provides pre-trained models and tools for natural language understanding (NLU) and generation (NLG) tasks in Chinese.
Chinese language model
Trains a large Chinese language model on massive data and provides a pre-trained model for downstream tasks
Chat model wrapper
Provides a framework for creating custom chat models with dynamic failover and load balancing features
