awesome-deep-learning

by Yoshua Bengio, Ian Goodfellow and Aaron Courville (05/07/2015)

by Michael Nielsen (Dec 2014)

by Microsoft Research (2013)

by LISA lab, University of Montreal (Jan 6 2015)

neuraltalk

by Andrej Karpathy : numpy-based RNN/LSTM implementation

numpy based interactive Deep Learning book

A book for optimization techniques during production

by Krishnendu Chaudhury

by Thushan Ganegedara

by Stephan Raaijmakers

by Andrew Ferlitsch

by Edward Raff

by François Chollet

by Micheal Lanham

by Chi Wang and Donald Szeto

by François Chollet with Tomasz Kalinowski and J. J. Allaire

by Liu Peng

by Grigory Sapunov

by Aurélien Géron | Oct 15, 2019

by Andrew Ng in Coursera (2010-2014)

by Yaser Abu-Mostafa (2012-2014)

by Tom Mitchell (Spring 2011)

by Geoffrey Hinton in Coursera (2012)

by Hugo Larochelle from Université de Sherbrooke (2013)

by CILVR lab @ NYU (2014)

by Dan Klein and Pieter Abbeel (2013)

by Patrick Henry Winston (2010)

by Shimon Ullman, Tomaso Poggio, Ethan Meyers @ MIT (2013)

by Fei-Fei Li, Andrej Karpathy (2017)

(2014-2015)

(2015)

by Geoffrey Hinton, Yoshua Bengio, Yann LeCun, Andrew Ng, Nando de Freitas and several others @ IPAM, UCLA (2012)

by Vincent Vanhoucke and Arpan Chakraborty (2016)

by Prof. Ali Ghodsi at University of Waterloo (2015)

by Prof. Larry Wasserman

by Yann LeCun (2016)

MSc in Artificial Intelligence for the University of Amsterdam

by Jeremy Howard - Fast.ai

by Prof. Bhiksha Raj (2017)

by Andrew Ng (2019)

A seven day bootcamp designed in MIT to introduce deep learning methods and applications (2019)

A free five-weekend plan to self-learners to learn the basics of deep-learning architectures like CNNs, LSTMs, RNNs, VAEs, GANs, DQN, A3C and more (2019)

A free deep reinforcement learning course by OpenAI (2019)

Breaking into AI with the best course from Andrew NG

by Alex Smola and Mu Li (2019)

by Nick Chase

-Google AI

Jeremy Howard - Fast.ai

a 3-6 month Udacity nanodegree, spanning multiple courses (2018)

by Beau Carnes (2018)

by Hakan Cebeci

List of Deep Learning online courses (some are free) from Classpert Online Course Search

Machine Learning and Deep Learning Courses from Amazon's Machine Learning university

A great introductory course on Deep Learning by Udacity and Facebook AI

Kaggle's free course on Deep Learning

DS-GA 1008 · SPRING 2021

COMP9444 19T3

By Ray Kurzweil

By Andrew Ng

By Geoff Hinton

by Yann LeCun

by Yoshua bengio

by Jeff Hawkins

by Adam Coates

By Adam Coates

By Adam Coates

By Yann LeCun

By Geoffrey Hinton at GoogleTechTalks

By Jeremy Howard at TEDxBrussels

by Andrew Ng in Stanford (2011)

By Chris Manning in Stanford

By Natalie Hammel and Lorraine Yurshansky

by Steve Jurvetson (and panel) at VLAB in Stanford

by Leo Isikdogan at Motorola Mobility HQ

NIPS 2016

: a series of mini-lectures by Leo Isikdogan on YouTube (2018)

By Oliver Zeigermann

: a live video course that teaches how to apply deep learning to text and images using the powerful Keras library and its R language interface

: This tutorial is styled as a graduate lecture about medical imaging with deep learning. This will cover the background of popular medical image domains (chest X-ray and histology) as well as methods to tackle multi-modality/view, segmentation, and counting tasks

: 2020 version

: Deep Reinforcement Learning

Course: 11-785, Intro to Deep Learning by Bhiksha Raj

: End part focuses on deep learning By Andrew Ng

Handwritten digits

from street view

80 Million tiny images6

100 Million Yahoo dataset

The Air Freight data set is a ray-traced image sequence along with ground truth segmentation based on textural characteristics. (455 images + GT, each 160x120 pixels). (Formats: PNG)

ALOI is a color image collection of one-thousand small objects, recorded for scientific purposes. In order to capture the sensory variation in object recordings, we systematically varied viewing angle, illumination angle, and illumination color for each object, and additionally captured wide-baseline stereo images. We recorded over a hundred images of each object, yielding a total of 110,250 images for the collection. (Formats: png)

Most images & annotations are supplemented by various ASM/AAM analyses using the AAM-API. (Formats: bmp,asf)

A variety of datasets including geons, objects, and "greebles". Good for testing recognition algorithms. (Formats: pict)

90K video frames in 90 sequences of various human activities, with XML ground truth of detection and behavior classification (Formats: MPEG2 & JPEG)

8 images (Formats: gif)

3 sets of 11 images, including color tiff images with spectroradiometry (Formats: gif, tiff)

A database of 41,368 face images of 68 people captured under 13 poses, 43 illuminations conditions, and with 4 different expressions

Images, sequences, stereo pairs (thousands of images) (Formats: Sun Rasterimage)

about 20 images - mostly top-down views of small objects and toys. (Formats: GIF)

Texture and reflectance measurements for over 60 samples of 3D texture, observed with over 200 different combinations of viewing and illumination directions. (Formats: bmp)

A dataset oriented towards computational color constancy, but useful for computer vision in general. It includes synthetic data, camera sensor data, and over 700 images. (Formats: tiff)

11 sets of color images for testing algorithms for content-based retrieval. Most sets have a description file with names of objects in each image. (Formats: jpg)

Densely sampled view spheres - upper half of the view sphere of two toy objects with 2500 images each. (Formats: tiff)

Digital embryos are novel objects which may be used to develop and test object recognition systems. They have an organic appearance. (Formats: various formats are available on request)

Images and Videos of his-res of studies taken from Gastrointestinal Video endoscopy. (Formats: jpg, mpg, gif)

Database contains 1002 face images showing subjects at different ages. (Formats: jpg)

FVC2000 is the First International Competition for Fingerprint Verification Algorithms. Four fingerprint databases constitute the FVC2000 benchmark (3520 fingerprints in all)

University of Bologna

Several image datasets of faces and gestures that are ground truth annotated for benchmarking

The database contains 35 gestures and consists of 1400 image sequences that contain gestures of 20 different persons recorded under non-uniform daylight lighting conditions. (Formats: mpg,jpg)

4000+ 1536x1024 (16 bit) calibrated outdoor images (Formats: homebrew)

2 turntable sequences from different viewing heights, 36 images each, resolution 1000x750, color (Formats: PPM)

1000+ images, mostly outdoor sequences (Formats: raw, ppm)

15 color image of simple objects (Formats: gif)

34 calibrated color stereo pairs (Formats: gif)

Images obtained from a variety of imaging modalities -- raw CFA images, range images and a host of "medical images". (Formats: homebrew)

An image database including some textures

The JAFFE database consists of 213 images of Japanese female subjects posing 6 basic facial expressions as well as a neutral pose. Ratings on emotion adjectives are also available, free of charge, for research purposes. (Formats: TIFF Grayscale images.)

44 image pairs. These data have been used in an evaluation of stereo analysis, as described in the April 1993 ARPA Image Understanding Workshop paper ``The JISCT Stereo Evaluation'' by R.C.Bolles, H.H.Baker, and M.J.Hannah, 263--274 (Formats: SSI)

Image archive (100+ images) (Formats: ppm)

hundreds of images (Formats: homebrew)

Images from the textbook by Jain, Kasturi, Schunck (20+ images) (Formats: GIF TIFF)

100 or more images of mammograms with ground truth. Additional images available by request, and links to several other mammography databases are provided. (Formats: homebrew)

many images (Formats: unknown)

Six multi-frame stereo data sets of scenes containing planar regions. Each data set contains 9 color images and subpixel-accuracy ground-truth data. (Formats: ppm)

Middlebury College

High Altitude Imagery from around the world for environmental modeling in support of NASA EOS program (Formats: JPG and HDF)

datasets - thousands of images (Formats: unknown)

compressed multipart uuencoded tar file

Color, CAT and MRI image samples - over 30 images (Formats: jpeg)

Over 55,000 3D CAD and solid models of (mostly) mechanical/machined engineering designs. (Formats: gif,vrml,wrl,stp,sat)

several sets of 3D object models collected over several years to use in object recognition research (Formats: homebrew, vrml)

Hundreds of real and synthetic images (Formats: gif, homebrew)

Over 1000 range images, 3D object models, still images and motion sequences (Formats: gif, ppm, vrml, homebrew)

Synthetic and real sequences with machine-readable ground truth optical flow fields, plus tools to generate ground truth for new sequences. (Formats: ppm,tif,homebrew)

Real and synthetic image sequences used for testing a Particle Image Velocimetry application. These images may be used for the test of optical flow and image matching algorithms. (Formats: pgm (raw))

This is the first 3D texture database which provides both full real surface rotations and registered photometric stereo data (30 textures, 1680 images). (Formats: TIFF)

9 synthetic sequences designed for testing motion analysis applications, including full ground truth of motion and camera parameters. (Formats: gif)

synthetic sequence for testing structure from motion algorithms (Formats: pgm)

a small set of synthetic images of a hallway with varying amounts of noise added. Use these images to benchmark your stereo algorithm. (Formats: raw, viff (khoros), or tiff)

A collection of synthetic range images taken from high-resolution polygonal models available on the web (Formats: homebrew)

Contains over 4,000 color images corresponding to 126 people's faces (70 men and 56 women). Frontal views with variations in facial expressions, illumination, and occlusions. (Formats: RAW (RGB 24-bit))

Database for testing multiclass object detection and scene recognition algorithms. Over 72,000 images with 2873 annotated frames. More than 50 annotated object classes. (Formats: jpg)

A collection of over 300 real images of 100 objects taken under three different illuminaiton conditions (Diffuse/Ambient/Directed). -- Use these images to test algorithms for detecting and compensating specular highlights in color images. (Formats: TIFF )

The XM2VTSDB contains four digital recordings of 295 people taken over a period of four months. This database contains both image and video data of faces

thousands of frames of digitized traffic image sequences as well as the 'Marbled Block' sequence (grayscale images) (Formats: GIF)

hundreds of images (Formats: Sun rasterfile)

(Formats: compressed raw)

Includes classifications - 1000+ color images (Formats: ppm)

a benchmark database for image retrieval with predefined ground truth. (Formats: tiff)

Large image database with aerial, space, stereo, medical images and more. (Formats: homebrew)

many images (Formats: GIF)

80 image sets (Formats: Sun rasterimage)

contains color images of faces under different illuminants and camera calibration conditions as well as skin spectral reflectance measurements of each person

Database of 320 surface textures, each captured under three illuminants, six spatial resolutions and nine rotation angles. A set of test suites is also provided so that texture segmentation, classification, and retrieval algorithms can be tested in a standard manner. (Formats: bmp, ras, xv)

Thousands of face images from many different sites (circa 994)

Images of 8 objects seen from many different view points. The view sphere is sampled using a geodesic with 172 images/sphere. Two sets for training and testing are available. (Formats: ppm)

Many images, many formats

Thousands of images of a cart, ladder, stool, bicycle, chairs, and cluttered scenes with ground truth labelings of edges and regions. (Formats: jpg)

165 images (15 individuals) with different lighting, expression, and occlusion configurations

5760 single light source images of 10 subjects each seen under 576 viewing conditions (9 poses x 64 illumination conditions). (Formats: PGM)

DeepMind QA Corpus

Textual QA corpus from CNN and DailyMail. More than 300K documents in total. for reference

YouTube-8M is a large-scale labeled video dataset that consists of 8 million YouTube video IDs and associated labels from a diverse vocabulary of 4800 visual entities

Open Images dataset

Open Images is a dataset of ~9 million URLs to images that have been annotated with labels spanning over 6000 categories

VOC2012 dataset containing 12k images with 20 annotated classes for object detection and segmentation

Fashion-MNIST

MNIST like fashion product dataset consisting of a training set of 60,000 examples and a test set of 10,000 examples. Each example is a 28x28 grayscale image, associated with a label from 10 classes

Contains over 800,000 diverse fashion images. Each image in this dataset is labeled with 50 categories, 1,000 descriptive attributes, bounding box and clothing landmarks

FakeNewsCorpus

Contains about 10 million news articles classified using types

LLVIP

15488 visible-infrared paired images (30976 images) for low-light vision research,

MSDA

Over over 5 million images from 5 different domains for multi-source ocr/text recognition DA research,

SANAD Dataset is a large collection of Arabic news articles that can be used in different Arabic NLP tasks such as Text Classification and Word Embedding. The articles were collected using Python scripts written specifically for three popular news websites: AlKhaleej, AlArabiya and Akhbarona

Two large-scale and complementary visio-linguistic datasets (aka Nr3D and Sr3D) for identifying fine-grained 3D objects in ScanNet scenes. Nr3D contains 41.5K natural, free-form utterances, and Sr3d contains 83.5K template-based utterances

Stanford released ~100,000 English QA pairs and ~50,000 unanswerable questions

~25,000 French QA pairs released by Illuin Technology

deepset released ~14,000 German QA pairs

SberQuAD

Sberbank released ~90,000 Russian QA pairs

Contains 450K affective annotations of emotional responses and linguistic explanations for 80,000 artworks of WikiArt

Maze

Application-oriented deep reinforcement learning framework addressing real-world decision problems

Nebullvm

Easy-to-use library to boost deep learning inference leveraging multiple deep learning compilers

Netron

Visualizer for deep learning and machine learning models

Web-based notebook environment for interactive computing

TensorBoard

TensorFlow's Visualization Toolkit

Develop, debug and deploy deep learning and AI solutions

TensorWatch

Debugging and visualization for deep learning

ML Workspace

All-in-one web-based IDE for machine learning and data science

dowel

A little logger for machine learning research. Log any object to the console, CSVs, TensorBoard, text log files, and more with just one call to

Lightweight tool for experiment tracking and results visualization

Browser extension ( and ) that automatically finds and links to code implementations for ML papers anywhere online: Google, Twitter, Arxiv, Scholar, etc

Determined

Deep learning training platform with integrated support for distributed training, hyperparameter tuning, smart GPU scheduling, experiment tracking, and a model registry

Community platform for Open Source ML – Manage experiments, data & models and create collaborative ML projects easily

hub

Fastest unstructured dataset management for TensorFlow/PyTorch by activeloop.ai. Stream & version-control data. Converts large data into single numpy-like array on the cloud, accessible on any machine

DVC is built to make ML models shareable and reproducible. It is designed to handle large files, data sets, machine learning models, and metrics as well as code

CML helps you bring your favorite DevOps tools to machine learning

MLEM is a tool to easily package, deploy and serve Machine Learning models. It seamlessly supports a variety of scenarios like real-time serving and batch processing

Dockerface

Easy to install and use deep learning Faster R-CNN face detection for images and video in a docker container

Awesome Deep Learning Music

Curated list of articles related to deep learning scientific research applied to music

Awesome Graph Embedding

Curated list of articles related to deep learning scientific research on graph structured data at the graph level

Awesome Network Embedding

Curated list of articles related to deep learning scientific research on graph structured data at the node level

Microsoft Recommenders

contains examples, utilities and best practices for building recommendation systems. Implementations of several state-of-the-art algorithms are provided for self-study and customization in your own applications

Andrej Karpathy blog post about using RNN for generating text

Ladder Network

Keras Implementation of Ladder Network for Semi-Supervised Learning

AI Expert Roadmap

Roadmap to becoming an Artificial Intelligence Expert