awesome-stable-diffusion

Diffusion tools

A curated list of resources and tools for working with the Stable Diffusion AI model.

Curated list of awesome resources for the Stable Diffusion AI Model.

GitHub
2k stars
41 watching
73 forks
last commit: over 1 year ago
Linked from 1 awesome list

aiawesomeawesome-listdiffusionesrganstable-diffusion

Awesome Stable-Diffusion
Non-Free 💵 marks content: commercial content that may require any kind of payment

Awesome Stable-Diffusion / Official Resources
Stable Diffusion 2.1 Release Notes Stable Diffusion 2.1 release notes
CompVis/Stable Diffusion 68,750 about 1 year ago The official release of Stable Diffusion including a CLI, an AI-based Safety Classifier, which detects and suppresses sexualized content, and all the necessary files to get running
stability-AI/stability-sdk 2,427 8 months ago The official SDK used to build python applications integrated with StabilityAI's cloud platform instead of hosting the model locally. Operation requires an API Key (🖊️💵)
Public Release Announcement StabilityAI's announcement about the public release of Stable Diffusion
Official Discord 🖊️ - The official Stable Diffusion Discord by StabilityAI
laion-aesthetic The dataset used train stable diffusion, useful for querying to see if a concept is represented

Awesome Stable-Diffusion / Actively Maintained Forks and Containers / Potentially Stale/Less active branches
neonsecret/stable-diffusion 592 over 2 years ago Fork focusing on bigger resolutions with less vram at the expense of speed, automatically adjusting to the GPUs abilities. Also includes upscaling, facial restoration via CodeFormer and

Awesome Stable-Diffusion / Checkpoints and Weights
sd-2.1 Base Model Cards (512px512px) 🖊️ - Model Cards/Weights for Stable Diffusion 2.1 (diffusion, upscaling and inpainting checkpoints)
sd-2.0 Model Cards 🖊️ - Model Cards/Weights for Stable Diffusion 2.0 (diffusion, upscaling and inpainting checkpoints)
sd-v1-5 from RunwayML 🖊️ - Stable Diffusion 1.5 Checkpoint released by runwayML
Official Model Card 1.5 🖊️ - Official Stability AI Model Card on Hugging Face with all versions of the model. Download requires sign-in and acceptance of terms of service

Awesome Stable-Diffusion / Checkpoints and Weights / Official Model Card 1.5
stable-diffusion-v-1-4-original.chkpt The original 1.4 model's card

Awesome Stable-Diffusion / Checkpoints and Weights
RealESRGAN Models 28,800 about 1 year ago Download location for the latest RealESRGAN models required to use the upscaling features implemented by many forks. Different models exist for realistic and anime content. Please refer to the fork documentation to identify the ones you
sd-v1-5-inpainting from RunwayML Checkpoint optimized for inpainting on SD 1.5, released by runwayML

Awesome Stable-Diffusion / Online Demos and Notebooks
HuggingFace/StabilityAI The official demo on HuggingFace Spaces
Offical Colab 🖊️💵 - The official, optimized colab for running SD on Google Cloud. Due to VRAM requirements required Colab Pro to create images
andreasjansson/stable-diffusion-animation Animate between prompts
Deforum 796 about 1 year ago Advanced notebook for Stable Diffusion with 2D, 3D, Video Input, and Interpolation animations. Includes inpainting, prompt batching, and more
Stable Diffusion Interpolation 🖊️ - AA simple implementation of generating N interpolated images (Colab)
huggingface/diffuse-the-rest Diffuse the Rest - img2img from simple sketches or uploaded images

Awesome Stable-Diffusion / Complementary Models and Tools
Civitai Model Repository Repository for custom models and textual inversion embeddings
Prompt to Prompt 1,307 almost 3 years ago Unofficial Implementation of Cross-attention-control for prompt to prompt image editing
sd-prompt-graph 21 almost 3 years ago This is a React-based curve editor GUI for prompt interpolation animations made with Stable Diffusion
DAAM 707 over 1 year ago Diffusion attention attribution maps, generating heatmaps modelling the impact of specific terms and tokens in the prompt on the final diffusion result
sd-concepts-library A library of user created embeddings to add new concepts to stable diffusion

Awesome Stable-Diffusion / Training / Upscaling
BasicSR 6,967 about 1 year ago Open-source upscaling and restoration toolbox supporting several models
BSRGAN 1,222 over 1 year ago BSRGAN—another upscaling solution specialized in upscaling degraded images
Cupscale 2,168 almost 3 years ago GUI for running various upscaling models, including ESRGAN and RealESRGAN
RealESRGAN 28,800 about 1 year ago ESRGAN Upscaling (2x, 4x) and content restoration. Python:
jquesnelle/txt2imghd 695 almost 3 years ago A port of the GOBIG mode from progrockdiffusion, providing high quality upscaling on top of txt2img
Upscale Wiki Model Database Wiki and model database for checkpoints compatible with ESRGAN et al

Awesome Stable-Diffusion / Training / Content Restoration
lama-cleaner 19,835 9 months ago Content aware AI inpainting tool useful for removing unwanted objects or defects from images. Python:
GFPGAN 36,009 about 1 year ago Face Restoration GAN included in several forks for automatically fixing the face deformation commonly found in SD output
CodeFormer 16,049 11 months ago Another Face Restoration model ( )

Awesome Stable-Diffusion / Training / Task Chaining
chaiNNer 4,714 9 months ago Graphical node-based editor for chaining image processing tasks
ai-art-generator 633 over 2 years ago AI art generation suite combining Stable Diffusion and other models for high volume art generation
dfserver 349 over 2 years ago distributed backend AI pipeline server for building self-hosted distributed GPU cluster to run the Stable Diffusion and various AI image or prompt building model

Awesome Stable-Diffusion / Training / Specialized Usecases
dream-textures 7,873 12 months ago A blender addon leveraging stable diffusion for texture creation
stable-dreamfusion 8,351 over 1 year ago An open source implementation of Google's text-to-3D dreamfusion paper with imagegen replaced by stable diffusion

Awesome Stable-Diffusion / Tutorials and Comparisons / Getting Up and Running
Stable Diffusion How To A basic tutorial on getting Stable Diffusion up and running
Installing on Windows A guide on installing and runing Stable Diffusion on Windows
Running on M1 Apple Silicon Reddit thread with instructions on running Stable Diffusion on Apple M1 CPU and GPU
Easy CPU-only Stable Diffusion A guide on setting up CPU-only Stable Diffusion for GNU/Linux without littering the system with dependencies
"Ultimate GUI Retard Guide" Tutorial for installing the

Awesome Stable-Diffusion / Tutorials and Comparisons / Learning and Mastering
Stable Diffusion Akashic Records 1,638 over 2 years ago A comprehensive curated list of guides, studies, keywords, prompts and artists
Sunny's Tips & Tricks Sunny's SD Tips & Tricks Google Doc with lots of visual comparisons and useful information
AI Image Generator Comparison A visual comparison between Dall-e, Stable Diffusion and Midjourney by PetaPixel.com
Getting great results at Stable Diffusion A guide on generating images that don't suck
Illustrated Stable Diffusion An illustrated primer on how Stable Diffusion works
Practical deep learning for coders high quality course by fast.ai aimed at coders that covers many aspects of deep learning, including stable-diffusion
Top SD Artists Searchable list of artists known by Stable Diffusion with example images

Awesome Stable-Diffusion / Tutorials and Comparisons / Studies
Modifier Studies Visual study of popular modifiers/keywords
Artist Studies Visual study of various artists

Awesome Stable-Diffusion / Tutorials and Comparisons / Extending Functionality
Building a SD Discord Bot A tutorial on building a Stable Diffusion Discord bot using Python

Awesome Stable-Diffusion / Community Resources
1 week of Stable Diffusion A curated list of Stable Diffusion services, adaptations, user interfaces and integrations
pharmapsychotic.com/tools A curated list of Tools and Resources for AI Art, including but not limited to Stable Diffusion
Stable Diffusion Resources A thorough resource for answering pressing questions about Stable Diffusion, including guides, tutorials, and best software

Awesome Stable-Diffusion / Social Media
r/StableDiffusion Stable Diffusion Subreddit. (Semi-official)
r/sdforall SDForAll
Diffusion Pulse Weekly Stable Diffusion newsletter

Awesome Stable-Diffusion / Plugins for third party apps
Blender Plugin 1,111 9 months ago Plugin for the free 3D modelling software Blender
Gimp Plugin 331 over 1 year ago Gimp Plugin
Krita Plugin 445 over 2 years ago A krita and Gimp SD plugin
Krita 5.0 Plugin 423 almost 3 years ago Another Krita Plugin based on the popular Automatic1111 fork
Photoshop Plugin 🖊️ - SD for Photoshop (Adobe Exchange)

Awesome Stable-Diffusion / Commercial SaaS and apps implementing Stable Diffusion
AI Art Generator (IOS) 🖊️💵 - iOS App to generate art using Stable Diffusion
aiimagegenerator.org Free online art generator for generating images using Stable Diffusion. Supports txt2img and img2img generation and inpainting
aiTransformer 🖊️ - Free online image/video transformation tools, including Super Stylizer based on Stable Diffusion, supports txt2img, img2img and img2txt (clip-interrogator)
Barium.ai 🖊️💵 - Generate PBR (physics based rendering) textures from text. Free and paid plans
Canva text-to-image 🖊️💵 - Text-to-image (beta) service from Canva
Dream Studio 🖊️💵 - Online art generation service by StabilityAI, the creators of Stable Diffusion. Similar to services like DALL-E or Midjourney, this operates on a credit model with a free allowance of credits given to signed up users on a monthly basis
dream.ai 🖊️💵 - Online art generation service by Wombo.ai (mobile apps available)
GimmeAPIs 🖊️💵 - Third party REST API Stable Diffusion service
Image Computer 🖊️💵 - Easy-to-use service aimed at non-technical people (comes with free trial credits)
Neural.love 🖊️💵 - Another online art generator with generous free credits as of Oct 2022
replicate.com stable diffusion 🖊️💵 - Another SaaS offering for Stable Diffusion
Starry AI (IOS) 🖊️💵 - Another IOS app offering stable diffusion with preset art styles
Stable Horde 🖊️ - Distributed stable diffusion cluster (think folding@home) with web, discord and telegram interfaces where joining with your GPU gives you priority
Stable Diffusion as API 🖊️💵 - Third party REST API into table Diffusion service
lowfuel/progrock-stable 166 over 2 years ago Fork with optional Web GUI and a different approach to upscaling (GoBIG/ESRGAN)
txt2imghd 695 almost 3 years ago Fork of progrock diffusion that creates detailed, higher-resolution images by first generating an image from a prompt, upscaling it, then running img2img on smaller pieces of the upscaled image, and blending the results back into the original image

Backlinks from these awesome lists:

More related projects: