DynamiCrafter
Video generator
This project generates animated videos from open-domain images by leveraging pre-trained video diffusion priors.
[ECCV 2024, Oral] DynamiCrafter: Animating Open-domain Images with Video Diffusion Priors
3k stars
32 watching
213 forks
Language: Python
last commit: 7 months ago
Linked from 1 awesome list
image-animationimage-to-videovideo-generation
amrzv/awesome-colab-notebooksRelated projects:
| Repository | Description | Stars |
|---|---|---|
 ailab-cvc/videocrafter | A toolbox for generating and editing video content using diffusion models | 4,606 |
| doubiiu/tooncrafter | Generates cartoon-style videos from two images using pre-trained diffusion models | 5,447 |
 cumulo-autumn/streamdiffusion | A pipeline-level solution for real-time interactive image generation using advanced diffusion techniques | 9,801 |
 lucidrains/dalle2-pytorch | An implementation of DALL-E 2's text-to-image synthesis neural network in PyTorch | 11,184 |
 huggingface/diffusers | A PyTorch-based library for training and using state-of-the-art diffusion models to generate images, audio, and 3D structures | 26,676 |
 nateraw/stable-diffusion-videos | Generates videos by manipulating the latent space of Stable Diffusion to create morphing sequences from text prompts. | 4,470 |
 open-mmlab/mmagic | A toolkit for building and experimenting with generative AI models for image and video generation, restoration, enhancement, and other tasks. | 6,986 |
 modelscope/diffsynth-studio | A software framework for training and utilizing various types of diffusion models. | 6,641 |
 ashawkey/stable-dreamfusion | Generates 3D content from text using a combination of neural networks and image synthesis. | 8,351 |
 facebookresearch/co-tracker | A model for tracking any point on a video using transformer-based architecture and optical flow benefits | 3,978 |
 deep-floyd/if | A text-to-image synthesis model with a modular design, utilizing a frozen text encoder and cascaded pixel diffusion modules to generate photorealistic images. | 7,699 |
 sczhou/propainter | A video inpainting tool using deep learning models to remove objects or fill in missing parts of videos. | 5,749 |
 hvision-nku/storydiffusion | This project provides an implementation of a self-attention mechanism for long-range image and video generation, enabling the creation of consistent narratives. | 6,030 |
 stability-ai/stablediffusion | A software project that enables high-resolution image synthesis through a specific type of generative model using latent diffusion processes. | 39,501 |
 clovaai/stargan-v2 | A Python implementation of an image-to-image translation model for generating diverse images across multiple domains. | 3,513 |