awesome-dl4nlp

NLP model builder guide

A curated collection of resources and guides for building and learning natural language processing models with deep learning techniques.

A curated list of awesome Deep Learning (DL) for Natural Language Processing (NLP) resources

GitHub

1k stars
99 watching
259 forks
last commit: over 3 years ago
Linked from 1 awesome list


Awesome Deep Learning for Natural Language Processing (NLP) / Courses / NLP with Deep Learning / CS224N from Stanford (Winter 2019)

Course homepageA complete survey of the field with videos, lecture slides, and sample student projects
Course lecturesVideo playlist
Previous course notes1,588about 9 years agoProbably the best "book" on DL for NLP
Course code2,957almost 7 years agoPytorch implementations of various Deep NLP models in cs-224n

Awesome Deep Learning for Natural Language Processing (NLP) / Courses / Neural Networks for NLP from Carnegie Mellon University

Course homepage
Course lectures
Course code1,310over 6 years ago

Awesome Deep Learning for Natural Language Processing (NLP) / Courses / Deep Learning for Natural Language Processing from University of Oxford and DeepMind

Course homepage
Course slides15,702about 3 years ago
Course lectures

Awesome Deep Learning for Natural Language Processing (NLP) / Books

Deep Learning with Text: Natural Language Processing (Almost) from Scratch with Python and spaCyby Patrick Harrison and Matthew Honnibal
Neural Network Methods in Natural Language Processingby Yoav Goldberg and Graeme Hirst
Deep Learning in Natural Language Processingby Li Deng and Yang Liu
Natural Language Processing in Actionby Hobson Lane, Cole Howard, and Hannes Hapke
Applied Natural Language Processing with Pythonby Taweh Beysolow II
Deep Learning Cookbookby Douwe Osinga
Deep Learning for Natural Language Processing: Creating Neural Networks with Pythonby Palash Goyal, Sumit Pandey, Karan Jain
Machine Learning for Textby Charu C. Aggarwal
Natural Language Processing with TensorFlowby Thushan Ganegedara
fastText Quick Start Guide: Get started with Facebook's library for text representation and classification
Hands-On Natural Language Processing with Python
Natural Language Processing in Action, Seond Editionby Hobson Lane and Maria Dyshel
Getting Started with Natural Language Processing in Actionby Ekaterina Kochmar
Deep Learning for Natural Language Processing in Actionby Stephan Raaijmakers

Awesome Deep Learning for Natural Language Processing (NLP) / Tutorials

Text classification guide from Google
Deep Learning for NLP with PyTorch

Awesome Deep Learning for Natural Language Processing (NLP) / Talks

Deep Learning for Natural Language Processing (without Magic)
A Primer on Neural Network Models for Natural Language Processing
Deep Learning for Natural Language Processing: Theory and Practice (Tutorial)
TensorFlow Tutorials
Practical Neural Networks for NLP433over 9 years agofrom EMNLP 2016 using DyNet framework
Recurrent Neural Networks with Word Embeddings
LSTM Networks for Sentiment Analysis
TensorFlow demo using the Large Movie Review Dataset
LSTMVis: Visual Analysis for Recurrent Neural Networks

Awesome Deep Learning for Natural Language Processing (NLP) / Talks / Using deep learning in natural language processing by Rob Romijnders from PyData Amsterdam 2017

video
slides1over 8 years ago

Awesome Deep Learning for Natural Language Processing (NLP) / Talks

Richard Socher's talk on sentiment analysis, question answering, and sentence-image embeddings
Deep Learning, an interactive introduction for NLP-ers
Deep Natural Language Understanding
Deep Learning Summer School, Montreal 2016Includes state-of-art language modeling

Awesome Deep Learning for Natural Language Processing (NLP) / Talks / Tackling the Limits of Deep Learning for NLP by Richard Socher

video
slides

Awesome Deep Learning for Natural Language Processing (NLP) / Papers

Deep or shallow, NLP is breaking outGeneral overview of how Deep Learning is impacting NLP
Natural Language Processing from Research at GoogleNot all Deep Learning (but mostly)
Context Dependent Recurrent Neural Network Language Model
Translation Modeling with Bidirectional Recurrent Neural Networks
Contextual LSTM (CLSTM) models for Large scale NLP tasks
LSTM Neural Networks for Language Modeling
Exploring the Limits of Language Modeling
Conversational Contextual CuesModels context and participants in conversations
Sequence to sequence learning with neural networks
Efficient Estimation of Word Representations in Vector Space
Learning Character-level Representations for Part-of-Speech Tagging
Representation Learning for Text-level Discourse Parsing
Fast and Robust Neural Network Joint Models for Statistical Machine Translation
Parsing With Compositional Vector Grammars
Smart Reply: Automated Response Suggestion for Email
Neural Architectures for Named Entity RecognitionState-of-the-art performance in NER with bidirectional LSTM with a sequential conditional random layer and transition-based parsing with stack LSTMs
Grammar as a Foreign LanguageState-of-the-art syntactic constituency parsing using generic sequence-to-sequence approach

Awesome Deep Learning for Natural Language Processing (NLP) / Blog Posts

Natural Language Processing (NLP) progressTracking the most common NLP tasks, including the datasets and the current state-of-the-art
A Review of the Recent History of Natural Language Processing
Deep Learning, NLP, and Representations
The Unreasonable Effectiveness of Recurrent Neural Networks
Neural Language Modeling From Scratch
Machine Learning for Emoji Trends
Teaching Robots to Feel: Emoji & Deep Learning
Computational Linguistics and Deep LearningOpinion piece on how Deep Learning fits into the broader picture of text processing
Deep Learning NLP Best Practices
7 types of Artificial Neural Networks for Natural Language Processing
How to solve 90% of NLP problems: a step-by-step guide
7 Applications of Deep Learning for Natural Language Processing

Awesome Deep Learning for Natural Language Processing (NLP) / Datasets

Dataset from "One Billion Word Language Modeling Benchmark"Almost 1B words, already pre-processed text
Stanford Sentiment TreebankFine grained sentiment labels for 215,154 phrases in the parse trees of 11,855 sentences
Chatbot data from Kaggle
A list of text datasets that are free/public domain in alphabetical order5,802over 3 years ago
Another list of text datasets that are free/public domain in reverse chronological order919over 6 years ago

Awesome Deep Learning for Natural Language Processing (NLP) / Word Embeddings and friends

The amazing power of word vectorsfrom The Morning Paper blog
Distributed Representations of Words and Phrases and their CompositionalityThe original word2vec paper
word2vec Parameter Learning ExplainedAn elucidating explanation of word2vec training
Word embeddings in 2017: Trends and future directions
Learning Word Vectors for 157 Languages
GloVe: Global Vectors for Word RepresentationA "count-based"/co-occurrence model to learn word embeddings

Awesome Deep Learning for Natural Language Processing (NLP) / Word Embeddings and friends / Doc2Vec

A gentle introduction to Doc2Vec
Distributed Representations of Sentences and Documents

Awesome Deep Learning for Natural Language Processing (NLP) / Word Embeddings and friends

Dynamic word embeddings for evolving semantic discoveryfrom The Morning Paper blog

Awesome Deep Learning for Natural Language Processing (NLP) / Word Embeddings and friends / Ali Ghodsi's lecture on word2vec:

part 1
part 2

Awesome Deep Learning for Natural Language Processing (NLP) / Word Embeddings and friends

word2vec analogy demo
TensorFlow Embedding Projector of word vectors

Awesome Deep Learning for Natural Language Processing (NLP) / Word Embeddings and friends / Skip-Thought Vectors

Paper
Code2,050over 6 years ago

Backlinks from these awesome lists:

More related projects: