awesome-deep-rl

awesome listHTMLpushed over 2 years ago

For deep RL and the future of AI.

AI summary

RL resources

A curated collection of resources and references for deep reinforcement learning research and applications.

stars: 1.4K
forks: 218
watching: 108
awesome lists: 3
entries: 162

What's in the list

162 links in 38 sections, with live GitHub stats.activeno commit in 2y

General guidances

Awesome Offline RL
942over 2 years
Reinforcement Learning Today
Multiagent Reinforcement Learning by Marc Lanctot RLSS @ Lille
11 July 2019
RLDM 2019 Notes by David Abel
11 July 2019
A Survey of Reinforcement Learning Informed by Natural Language
10 Jun 2019
Challenges of Real-World Reinforcement Learning
29 Apr 2019
Ray Interference: a Source of Plateaus in Deep Reinforcement Learning
25 Apr 2019
Principles of Deep RL by David Silver
University AI's General introduction to deep rl (in Chinese)
OpenAI's spinningup
The Promise of Hierarchical Reinforcement Learning
9 Mar 2019
Deep Reinforcement Learning that Matters
30 Jan 2019

2024

Foundation Policies with Hilbert Representations
23 Feb 2024

2022

arxiv
Reinforcement Learning with Action-Free Pre-Training from Videos

Generalist policies

Foundation Policies with Hilbert Representations
23 Feb 2024

Foundations and theory

General non-linear Bellman equations
9 July 2019
Monte Carlo Gradient Estimation in Machine Learning
25 Jun 2019

General benchmark frameworks

Brax
2.4Kalmost 2 years
Android-Env
1Kalmost 2 years
MuJoCo
|
Unsupervised RL Benchmark
335almost 4 years
Dataset for Offline RL
1.4Kalmost 2 years
Spriteworld: a flexible, configurable python-based reinforcement learning environment
369over 6 years
Chainerrl Visualizer
54over 3 years
Behaviour Suite for Reinforcement Learning
13 Aug 2019 |
Quantifying Generalization in Reinforcement Learning
20 Dec 2018
S-RL Toolbox: Environments, Datasets and Evaluation Metrics for State Representation Learning
25 Sept 2018
dopamine
10.6Kalmost 2 years
StarCraft II
8K2 years
tfrl
3.1Kalmost 4 years
chainerrl
1.2K5 years
PARL
3.3K2 years
DI-engine: a generalized decision intelligence engine. It supports various Deep RL algorithms
3.1Kalmost 2 years
PPO x Family: Course in Chinese for Deep RL
2Kover 2 years

Unsupervised

URLB: Unsupervised Reinforcement Learning Benchmark
28 Oct 2021
APS: Active Pretraining with Successor Feature
31 Aug 2021
Behavior From the Void: Unsupervised Active Pre-Training
8 Mar 2021
Reinforcement Learning with Prototypical Representations
22 Feb 2021
Efficient Exploration via State Marginal Matching
12 Jun 2019
Self-Supervised Exploration via Disagreement
10 Jun 2019
Exploration by Random Network Distillation
30 Oct 2018
Diversity is All You Need: Learning Skills without a Reward Function
16 Feb 2018
Curiosity-driven Exploration by Self-supervised Prediction
15 May 2017

Offline

Value based

Harnessing Structures for Value-Based Planning and Reinforcement Learning
5 Feb 2020 |
Recurrent Value Functions
23 May 2019
Stochastic Lipschitz Q-Learning
24 Apr 2019
TreeQN and ATreeC: Differentiable Tree-Structured Models for Deep Reinforcement Learning
8 Mar 2018
DISTRIBUTED PRIORITIZED EXPERIENCE REPLAY
2 Mar 2018
Rainbow: Combining Improvements in Deep Reinforcement Learning
6 Oct 2017
Learning from Demonstrations for Real World Reinforcement Learning
12 Apr 2017
Dueling Network Architecture
Double DQN
Prioritized Experience
Deep Q-Networks

Policy gradient

Explorations

Entropic Desired Dynamics for Intrinsic Control
2021
Self-Supervised Exploration via Disagreement
10 Jun 2019
Approximate Exploration through State Abstraction
24 Jan 2019
The Uncertainty Bellman Equation and Exploration
15 Sep 2017
Noisy Networks for Exploration
30 Jun 2017
Count-Based Exploration in Feature Space for Reinforcement Learning
25 Jun 2017
Count-Based Exploration with Neural Density Models
14 Jun 2017
UCB and InfoGain Exploration via Q-Ensembles
11 Jun 2017
Minimax Regret Bounds for Reinforcement Learning
16 Mar 2017
Incentivizing Exploration In Reinforcement Learning With Deep Predictive Models
EX2: Exploration with Exemplar Models for Deep Reinforcement Learning

Actor-Critic

Model-based

Self-Consistent Models and Values
25 Oct 2021
When to use parametric models in reinforcement learning?
12 Jun 2019
Model Based Reinforcement Learning for Atari
5 Mar 2019
Model-Based Stabilisation of Deep Reinforcement Learning
6 Sep 2018
Learning model-based planning from scratch
19 July 2017

Model-free + Model-based

Imagination-Augmented Agents for Deep Reinforcement Learning
19 July 2017

Hierarchical

WHY DOES HIERARCHY (SOMETIMES) WORK SO WELL IN REINFORCEMENT LEARNING?
23 Sep 2019
Language as an Abstraction for Hierarchical Deep Reinforcement Learning
18 Jun 2019

Option

Variational Option Discovery Algorithms
26 July 2018
A Laplacian Framework for Option Discovery in Reinforcement Learning
16 Jun 2017

Connection with other methods

Connecting value and policy methods

Reward design

End-to-End Robotic Reinforcement Learning without Reward Engineering
16 Apr 2019
Reinforcement Learning with Corrupted Reward Channel
23 May 2017

Unifying

Multi-step Reinforcement Learning: A Unifying Algorithm

Faster DRL

Neural Episodic Control

Multi-agent

No Press Diplomacy: Modeling Multi-Agent Gameplay
4 Sep 2019
Options as responses: Grounding behavioural hierarchies in multi-agent RL
6 Jun 2019
Evolutionary Reinforcement Learning for Sample-Efficient Multiagent Coordination
18 Jun 2019
A Regularized Opponent Model with Maximum Entropy Objective
17 May 2019
Deep Q-Learning for Nash Equilibria: Nash-DQN
23 Apr 2019
Malthusian Reinforcement Learning
3 Mar 2019
Bayesian Action Decoder for Deep Multi-Agent Reinforcement Learning
4 Nov 2018
INTRINSIC SOCIAL MOTIVATION VIA CAUSAL INFLUENCE IN MULTI-AGENT RL
19 Oct 2018
QMIX: Monotonic Value Function Factorisation for Deep Multi-Agent Reinforcement Learning
30 Mar 2018
Modeling Others using Oneself in Multi-Agent Reinforcement Learning
26 Feb 2018
The Mechanics of n-Player Differentiable Games
15 Feb 2018
Continuous Adaptation via Meta-Learning in Nonstationary and Competitive Environments
10 Oct 2017
Learning with Opponent-Learning Awareness
13 Sep 2017
Counterfactual Multi-Agent Policy Gradients
Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environments
7 Jun 2017
Multiagent Bidirectionally-Coordinated Nets for Learning to Play StarCraft Combat Games
29 Mar 2017

New design

Multitask

Kickstarting Deep Reinforcement Learning
10 Mar 2018
Zero-Shot Task Generalization with Multi-Task Deep Reinforcement Learning
7 Nov 2017
Distral: Robust Multitask Reinforcement Learning
13 July 2017

Observational Learning

Observational Learning by Reinforcement Learning
20 Jun 2017

Meta Learning

Discovery of Useful Questions as Auxiliary Tasks
10 Sep 2019
Meta-learning of Sequential Strategies
8 May 2019
Efficient Off-Policy Meta-Reinforcement Learning via Probabilistic Context Variables
19 Mar 2019
Some Considerations on Learning to Explore via Meta-Reinforcement Learning
11 Jan 2019
Meta-Gradient Reinforcement Learning
24 May 2018
ProMP: Proximal Meta-Policy Search
16 Oct 2018
Unsupervised Meta-Learning for Reinforcement Learning
12 Jun 2018

Distributional

GAN Q-learning
20 July 2018
Implicit Quantile Networks for Distributional Reinforcement Learning
14 Jun 2018
Nonlinear Distributional Gradient Temporal-Difference Learning
20 May 2018
DISTRIBUTED DISTRIBUTIONAL DETERMINISTIC POLICY GRADIENTS
23 Apr 2018
An Analysis of Categorical Distributional Reinforcement Learning
22 Feb 2018
Distributional Reinforcement Learning with Quantile Regression
27 Oct 2017
A Distributional Perspective on Reinforcement Learning
21 July 2017

Planning

Search on the Replay Buffer: Bridging Planning and Reinforcement Learning
12 June 2019

Safety

Robust Reinforcement Learning for Continuous Control with Model Misspecification
18 Jun 2019
Verifiable Reinforcement Learning via Policy Extraction
22 May 2018

Inverse RL

ADDRESSING SAMPLE INEFFICIENCY AND REWARD BIAS IN INVERSE REINFORCEMENT LEARNING
9 Sep 2018

No reward RL

Fast Task Inference with Variational Intrinsic Successor Features
2 Jun 2019
Curiosity-driven Exploration by Self-supervised Prediction
15 May 2017

Time

Adversarial learning

Sample-efficient Adversarial Imitation Learning from Observation
18 Jun 2019

Use Natural Language

Using Natural Language for Reward Shaping in Reinforcement Learning
31 May 2019

Generative and contrastive representation learning

Unsupervised State Representation Learning in Atari
19 Jun 2019

Belief

Shaping Belief States with Generative Environment Models for RL
24 Jun 2019

PAC

Provably Convergent Off-Policy Actor-Critic with Function Approximation
11 Nov 2019

Applications

Featured in 3 awesome lists

Each link jumps to the spot where the list mentions awesome-deep-rl.

More related projects