ai4artists
by jonathandinu
A list of AI Art courses, tools, libraries, people, and places.
AI summary
AI art resource hub
A collection of resources and information on the intersection of AI and art, providing an overview of various tools, techniques, and learning paths.
- stars
- 348
- forks
- 25
- watching
- 14
- awesome list
- 1
- entries
- 255
What's in the list
255 links in 27 sections, with live GitHub stats.activeno commit in 2y
Courses
Courses / Introduction to Computational Media (ITP/NYU)
Videos
Books
Tutorials and Blogs
Papers/Methods
- SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equations
: Paper predating Stable Diffusion describing a method for image synthesis and editing with diffusion based models
- High-Resolution Image Synthesis with Latent Diffusion Models
: Original paper that introduced Stable Diffusion and started it all
- Prompt-to-Prompt Image Editing with Cross-Attention Control
: Edit Stable Diffusion outputs by editing the original prompt
- An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversion
: Similar to prompt-to-prompt but instead takes an input image and a text description. Kinda like Style Transfer... but with Stable diffusion
- DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation
: Similar to Textual Inversion but instead focused on manipulating subject based images (i.e. but )
- Multi-Concept Customization of Text-to-Image Diffusion
: Like DreamBooth but capable of synthesizing multiple concepts
- Structure-from-Motion Revisited
: prior work on sparse modeling (still needed/useful for NeRF)
- Pixelwise View Selection for Unstructured Multi-View Stereo
: prior work on dense modeling (NeRF kinda replaces this)
- Neural Radiance Fields for Unconstrained Photo Collections
: NeRF in the wild (alternative to MVS)
- Nerfies: Deformable Neural Radiance Fields
: Photorealistic NeRF from casual in-the-wild photos and videos (like from a cellphone)
- Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fields
: NeRF... but BETTER FASTER HARDER STRONGER
- Depth-supervised NeRF: Fewer Views and Faster Training for Free
: Train NeRF models faster with fewer images by leveraging depth information
- Instant Neural Graphics Primitives with a Multiresolution Hash Encoding
: caching for NeRF training to make it rlllly FAST
- Understanding Pure CLIP Guidance for Voxel Grid NeRF Models
: text-to-3D using CLIP
- NeRF-SLAM: Real-Time Dense Monocular SLAM with Neural Radiance Fields
: NeRF for robots (and cars)
- nerf2nerf: Pairwise Registration of Neural Radiance Fields
: pretrained NeRF
3D and point clouds
Unconditional Image Synthesis
Conditional Image Synthesis (and inverse problems)
GAN inversion (and editing)
Latent Space Interpretation
Image Matting
Tools / Generative Modeling
NVIDIA Imaginaire
: 2D Image synthesis library
- NVIDIA Omniverse
: The platform for creating and operating metaverse applications
- Modelverse
: Content-Based Search for Deep Generative Models
Tools / Creative ML
Tools / Deep Learning Frameworks
Tools / Runtimes/Deployment
Tools / Text-to-Image
- Muse: Text-To-Image Generation via Masked Generative Transformers
: More efficient than diffusion or autoregressive text-to-image models used masked image modeling w/ transformers
Tools / Stable Diffusion (SD)
- Dream Studio
: Official cloud hosted service
features
⭐️ : A user friendly UI for SD with additional to make common workflows easy
- AI render (Blender)
: Render scenes in Blender using a text prompt
Dream Textures (Blender)
: Plugin to render textures, reference images, and background with SD
- lexica.art
SD Prompt Search
koi (Krita)
: SD plugin for for img2img generation
- Alpaca (Photoshop)
: Photoshop plugin (beta)
- Christian Cantrell's Plugin (Photoshop)
: Another Photoshop plugin
Stable Diffusion Studio
: Animation focused frontend for SD
DeepSpeed-MII
: Low-latency and high-throughput inference for a variety (20,000+) models/tasks, including SD
Tools / Neural Radiance Fields
Tools / Creative Coding
Datasets / Permissively Licensed/Open Access
LAION Datasets
: Various very large scale image-text pairs datasets (notably used to train the open source models)
- Open Images
: Open Images is a dataset of ~9M images annotated with image-level labels, object bounding boxes, object segmentation masks, visual relationships, and localized narratives:
- Mozilla Common Voice
: 17,127 validated hours of transcribed speech covering 104 languages. Additionally many of the recorded hours in the dataset also include demographic metadata like age, sex, and accent that can help improve the accuracy of speech recognition engines
- Flickr Commons
: Flickr Commons is a unique collection of historical photography from over 100 cultural institutions from all around the world, all with no known copyright restrictions
- Internet Archive
: Internet Archive is a non-profit library of millions of free books, movies, software, music, websites, and more
- Wikimedia Commons
: a collection of 106,323,506 freely usable media files to which anyone can contribute
- Getty Library Open Content Program
: Making images from Getty’s collections freely available for study, teaching, and enjoyment
- Public Domain Review
: Focused on works now fallen into the public domain, the vast commons of out-of-copyright material that everyone is free to enjoy, share, and build upon without restrictions
- PASS
: An ImageNet replacement for self-supervised pretraining without humans which can be used for high-quality pretraining while significantly reducing privacy concerns
Datasets / Faces/People (restricted licenses)
- SSHQ
: full body 1024 x 512px
Datasets / Other
Products/Apps
- Runway
AI powered video editor
- Facet AI
AI powered image editor
- Adobe Sensei
AI powered features for the Creative Cloud suite
- ClipDrop
and
Artists
Institutions/Places
- Tokyo
Sony CSL ( and )
Related lists and collections
- Tools and Resources for AI Art (pharmapsychotic)
Big list of Google Colab notebooks for generative text-to-image techniques as well as general tools and resources
Awesome Generative Deep Art
A curated list of Generative Deep Art / Generative AI projects, tools, artworks, and models
Nothing in this list matches your filter.
Featured in 1 awesome list
Each link jumps to the spot where the list mentions ai4artists.
More related projects
open-mmlab/mmaction24.4K
open-mmlab/mmdetection29.8K
open-mmlab/mmcv5.9K
open-mmlab/mmdetection3d5.4K
open-mmlab/mmengine1.2K
open-mmlab/mmsegmentation8.4K
open-mmlab/mmpose6K
auto1111sdk/auto1111sdk399
open-mmlab/mmhuman3d1.3K
open-mmlab/mmdeploy2.8K
german-nlp-group/german-transformer-training23
flagai-open/flagai3.8K
espnet/espnet8.6K