CogVideo
by THUDM
text and image to video generation: CogVideoX (2024) and CogVideo (ICLR 2023)
AI summary
Video generator
Generates videos from text and images using large language models
- stars
- 9.8K
- forks
- 922
- watching
- 129
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
Visual Language Model
Develops a state-of-the-art visual language model with applications in image understanding and dialogue systems.
Video generator
This project generates animated videos from open-domain images by leveraging pre-trained video diffusion priors.
Image generator
A framework for generating images from text using transformers.
Cartoonizer
Generates cartoon-style videos from two images using pre-trained diffusion models
Anime style generator
A tool that generates anime styles from landscape photos and videos using deep learning techniques.
coqui-ai/tts36.1K
Speech generator
A deep learning toolkit for generating human-like speech from text
Code generator
A multilingual code generation model with pre-trained weights on 20 programming languages and capabilities for generating executable programs and translating between different languages.
Point tracker
A model for tracking any point on a video using transformer-based architecture and optical flow benefits
Content generator
A unified framework for 3D content generation
Vision-Language Model
Enabling vision-language understanding by fine-tuning large language models on visual data.
Multimodal model
A comprehensive multimodal system for long-term streaming video and audio interactions with capabilities including text-image comprehension and composition
nvidia/vid2vid8.6K
Video translator
A PyTorch implementation of a video-to-video translation method for generating photorealistic videos from semantic label maps or other input data.
STT toolkit
A toolkit for building and deploying speech-to-text models using deep learning techniques
Diffusion pipeline
A pipeline-level solution for real-time interactive image generation using advanced diffusion techniques
Image translator
A Python implementation of an image-to-image translation model for generating diverse images across multiple domains.
Featured in 1 awesome list
Each link jumps to the spot where the list mentions CogVideo.
