DynamiCrafter
Video generator
This project generates animated videos from open-domain images by leveraging pre-trained video diffusion priors.
[ECCV 2024, Oral] DynamiCrafter: Animating Open-domain Images with Video Diffusion Priors
3k stars
33 watching
206 forks
Language: Python
last commit: 2 months ago
Linked from 1 awesome list
image-animationimage-to-videovideo-generation
amrzv/awesome-colab-notebooksRelated projects:
| Repository | Description | Stars |
|---|---|---|
 ailab-cvc/videocrafter | A toolbox for generating and editing video content using diffusion models | 4,561 |
| doubiiu/tooncrafter | Generates cartoon-style videos from two images using pre-trained diffusion models | 5,353 |
 cumulo-autumn/streamdiffusion | A pipeline-level solution for real-time interactive image generation using diffusion-based techniques | 9,736 |
 lucidrains/dalle2-pytorch | An implementation of DALL-E 2's text-to-image synthesis neural network in PyTorch | 11,148 |
 huggingface/diffusers | A PyTorch-based library for training and using state-of-the-art diffusion models to generate images, audio, and 3D structures | 26,223 |
 nateraw/stable-diffusion-videos | Generates videos by manipulating the latent space of Stable Diffusion to create morphing sequences from text prompts. | 4,453 |
 open-mmlab/mmagic | A toolkit for building and experimenting with generative AI models for image and video generation, restoration, enhancement, and other tasks. | 6,945 |
 modelscope/diffsynth-studio | A software framework for training and utilizing various types of diffusion models. | 6,580 |
 ashawkey/stable-dreamfusion | Generates 3D content from text using a combination of neural networks and image synthesis. | 8,296 |
 facebookresearch/co-tracker | A model for tracking any point on a video using transformer-based architecture and optical flow benefits | 3,820 |
 deep-floyd/if | A text-to-image synthesis model with a modular design, utilizing a frozen text encoder and cascaded pixel diffusion modules to generate photorealistic images. | 7,688 |
 sczhou/propainter | A video inpainting tool using deep learning models to remove objects or fill in missing parts of videos. | 5,671 |
 hvision-nku/storydiffusion | This project provides an implementation of a self-attention mechanism for long-range image and video generation, enabling the creation of consistent narratives. | 5,943 |
 stability-ai/stablediffusion | A software project that enables high-resolution image synthesis through a specific type of generative model using latent diffusion processes. | 39,192 |
 clovaai/stargan-v2 | A Python implementation of an image-to-image translation model for generating diverse images across multiple domains. | 3,500 |