awesome-dl4nlp

NLP model builder guide

A curated collection of resources and guides for building and learning natural language processing models with deep learning techniques.

A curated list of awesome Deep Learning (DL) for Natural Language Processing (NLP) resources

GitHub
1k stars
99 watching
259 forks
last commit: almost 3 years ago
Linked from 1 awesome list


Awesome Deep Learning for Natural Language Processing (NLP) / Courses / NLP with Deep Learning / CS224N from Stanford (Winter 2019)
Course homepage A complete survey of the field with videos, lecture slides, and sample student projects
Course lectures Video playlist
Previous course notes 1,588 over 8 years ago Probably the best "book" on DL for NLP
Course code 2,957 about 6 years ago Pytorch implementations of various Deep NLP models in cs-224n

Awesome Deep Learning for Natural Language Processing (NLP) / Courses / Neural Networks for NLP from Carnegie Mellon University
Course homepage
Course lectures
Course code 1,310 almost 6 years ago

Awesome Deep Learning for Natural Language Processing (NLP) / Courses / Deep Learning for Natural Language Processing from University of Oxford and DeepMind
Course homepage
Course slides 15,702 over 2 years ago
Course lectures

Awesome Deep Learning for Natural Language Processing (NLP) / Books
Deep Learning with Text: Natural Language Processing (Almost) from Scratch with Python and spaCy by Patrick Harrison and Matthew Honnibal
Neural Network Methods in Natural Language Processing by Yoav Goldberg and Graeme Hirst
Deep Learning in Natural Language Processing by Li Deng and Yang Liu
Natural Language Processing in Action by Hobson Lane, Cole Howard, and Hannes Hapke
Applied Natural Language Processing with Python by Taweh Beysolow II
Deep Learning Cookbook by Douwe Osinga
Deep Learning for Natural Language Processing: Creating Neural Networks with Python by Palash Goyal, Sumit Pandey, Karan Jain
Machine Learning for Text by Charu C. Aggarwal
Natural Language Processing with TensorFlow by Thushan Ganegedara
fastText Quick Start Guide: Get started with Facebook's library for text representation and classification
Hands-On Natural Language Processing with Python
Natural Language Processing in Action, Seond Edition by Hobson Lane and Maria Dyshel
Getting Started with Natural Language Processing in Action by Ekaterina Kochmar
Deep Learning for Natural Language Processing in Action by Stephan Raaijmakers

Awesome Deep Learning for Natural Language Processing (NLP) / Tutorials
Text classification guide from Google
Deep Learning for NLP with PyTorch

Awesome Deep Learning for Natural Language Processing (NLP) / Talks
Deep Learning for Natural Language Processing (without Magic)
A Primer on Neural Network Models for Natural Language Processing
Deep Learning for Natural Language Processing: Theory and Practice (Tutorial)
TensorFlow Tutorials
Practical Neural Networks for NLP 433 over 8 years ago from EMNLP 2016 using DyNet framework
Recurrent Neural Networks with Word Embeddings
LSTM Networks for Sentiment Analysis
TensorFlow demo using the Large Movie Review Dataset
LSTMVis: Visual Analysis for Recurrent Neural Networks

Awesome Deep Learning for Natural Language Processing (NLP) / Talks / Using deep learning in natural language processing by Rob Romijnders from PyData Amsterdam 2017
video
slides 1 over 7 years ago

Awesome Deep Learning for Natural Language Processing (NLP) / Talks
Richard Socher's talk on sentiment analysis, question answering, and sentence-image embeddings
Deep Learning, an interactive introduction for NLP-ers
Deep Natural Language Understanding
Deep Learning Summer School, Montreal 2016 Includes state-of-art language modeling

Awesome Deep Learning for Natural Language Processing (NLP) / Talks / Tackling the Limits of Deep Learning for NLP by Richard Socher
video
slides

Awesome Deep Learning for Natural Language Processing (NLP) / Papers
Deep or shallow, NLP is breaking out General overview of how Deep Learning is impacting NLP
Natural Language Processing from Research at Google Not all Deep Learning (but mostly)
Context Dependent Recurrent Neural Network Language Model
Translation Modeling with Bidirectional Recurrent Neural Networks
Contextual LSTM (CLSTM) models for Large scale NLP tasks
LSTM Neural Networks for Language Modeling
Exploring the Limits of Language Modeling
Conversational Contextual Cues Models context and participants in conversations
Sequence to sequence learning with neural networks
Efficient Estimation of Word Representations in Vector Space
Learning Character-level Representations for Part-of-Speech Tagging
Representation Learning for Text-level Discourse Parsing
Fast and Robust Neural Network Joint Models for Statistical Machine Translation
Parsing With Compositional Vector Grammars
Smart Reply: Automated Response Suggestion for Email
Neural Architectures for Named Entity Recognition State-of-the-art performance in NER with bidirectional LSTM with a sequential conditional random layer and transition-based parsing with stack LSTMs
Grammar as a Foreign Language State-of-the-art syntactic constituency parsing using generic sequence-to-sequence approach

Awesome Deep Learning for Natural Language Processing (NLP) / Blog Posts
Natural Language Processing (NLP) progress Tracking the most common NLP tasks, including the datasets and the current state-of-the-art
A Review of the Recent History of Natural Language Processing
Deep Learning, NLP, and Representations
The Unreasonable Effectiveness of Recurrent Neural Networks
Neural Language Modeling From Scratch
Machine Learning for Emoji Trends
Teaching Robots to Feel: Emoji & Deep Learning
Computational Linguistics and Deep Learning Opinion piece on how Deep Learning fits into the broader picture of text processing
Deep Learning NLP Best Practices
7 types of Artificial Neural Networks for Natural Language Processing
How to solve 90% of NLP problems: a step-by-step guide
7 Applications of Deep Learning for Natural Language Processing

Awesome Deep Learning for Natural Language Processing (NLP) / Datasets
Dataset from "One Billion Word Language Modeling Benchmark" Almost 1B words, already pre-processed text
Stanford Sentiment Treebank Fine grained sentiment labels for 215,154 phrases in the parse trees of 11,855 sentences
Chatbot data from Kaggle
A list of text datasets that are free/public domain in alphabetical order 5,802 over 2 years ago
Another list of text datasets that are free/public domain in reverse chronological order 919 almost 6 years ago

Awesome Deep Learning for Natural Language Processing (NLP) / Word Embeddings and friends
The amazing power of word vectors from The Morning Paper blog
Distributed Representations of Words and Phrases and their Compositionality The original word2vec paper
word2vec Parameter Learning Explained An elucidating explanation of word2vec training
Word embeddings in 2017: Trends and future directions
Learning Word Vectors for 157 Languages
GloVe: Global Vectors for Word Representation A "count-based"/co-occurrence model to learn word embeddings

Awesome Deep Learning for Natural Language Processing (NLP) / Word Embeddings and friends / Doc2Vec
A gentle introduction to Doc2Vec
Distributed Representations of Sentences and Documents

Awesome Deep Learning for Natural Language Processing (NLP) / Word Embeddings and friends
Dynamic word embeddings for evolving semantic discovery from The Morning Paper blog

Awesome Deep Learning for Natural Language Processing (NLP) / Word Embeddings and friends / Ali Ghodsi's lecture on word2vec:
part 1
part 2

Awesome Deep Learning for Natural Language Processing (NLP) / Word Embeddings and friends
word2vec analogy demo
TensorFlow Embedding Projector of word vectors

Awesome Deep Learning for Natural Language Processing (NLP) / Word Embeddings and friends / Skip-Thought Vectors
Paper
Code 2,050 over 5 years ago

Backlinks from these awesome lists:

More related projects: