Contrastive Explanations for Reinforcement Learning via Embedded Self Predictions

Q-learning

Christopher JCH Watkins and Peter Dayan · 1992

Earlier work this paper cites.

Neuro-dynamic programming

Dimitri P Bertsekas and John N Tsitsiklis · 1996

Earlier work this paper cites.

Q-decomposition for reinforcement learning agents

Stuart J Russell and Andrew Zimdars · 2003

Earlier work this paper cites.

Sparse cooperative q-learning

Jelle R Kok and Nikos Vlassis · 2004

Earlier work this paper cites.

Minimal sufficient explanations for factored markov decision processes

Omar Zia Khan, Pascal Poupart, and James P Black · 2009

Earlier work this paper cites.

Horde : A scalable real-time architecture for learning knowledge from unsupervised sensorimotor interaction categories and subject descriptors

Richard Sutton, Joseph Modayil, Michael Delp, Thomas Degris, Patrick Pilarski, Adam White, and Doina Precup · 2011

Earlier work this paper cites.

Continuous control with deep reinforcement learning

Original

Timothy P Lillicrap, Jonathan J Hunt, Alexander Pritzel, Nicolas Heess, Tom Erez, Yuval Tassa, David Silver, and Daan Wierstra · 2015

Earlier work this paper cites.

Human-level control through deep reinforcement learning

Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Andrei A Rusu, Joel Veness, Marc G Bellemare, Alex Graves, Martin Riedmiller, Andreas K Fidjeland, Georg Ostrovski, et al · 2015

Cited alongside, same era.

Axiomatic attribution for deep networks

Mukund Sundararajan, Ankur Taly, and Qiqi Yan · 2017

Cited alongside, same era.

Hybrid reward architecture for reinforcement learning

Harm Van Seijen, Mehdi Fatemi, Joshua Romoff, Romain Laroche, Tavian Barnes, and Jeffrey Tsang · 2017

Cited alongside, same era.

Visualizing and understanding Atari agents

Samuel Greydanus, Anurag Koul, Jonathan Dodge, and Alan Fern · 2018

Cited alongside, same era.

Transparency and explanation in deep reinforcement learning neural networks

Original

Rahul Iyer, Yuezhang Li, Huao Li, Michael Lewis, Ramitha Sundar, and Katia P. Sycara · 2018

Cited alongside, same era.

Contrastive explanations for reinforcement learning in terms of expected consequences

J Waa, J van Diggelen, K Bosch, and M Neerincx · 2018

Later among the works it cites.

Explainable reinforcement learning via reward decomposition

Zoe Juozapaitis, Anurag Koul, Alan Fern, Martin Erwig, and Finale Doshi-Velez · 2019

Later among the works it cites.

Counterfactual states for atari agents via generative deep learning

Original

Matthew L Olson, Lawrence Neal, Fuxin Li, and Weng-Keen Wong · 2019

Later among the works it cites.

Grandmaster level in starcraft ii using multi-agent reinforcement learning

Oriol Vinyals, Igor Babuschkin, Wojciech M. Czarnecki, Michaël Mathieu, Andrew Dudzik, Junyoung Chung, David H. Choi, Richard Powell, Timo Ewalds, Petko Georgiev, and et al · 2019

Later among the works it cites.

Exploratory not explanatory: Counterfactual analysis of saliency maps for deep {rl}

Akanksha Atrey, Kaleigh Clary, and David Jensen · 2020

Closest in time.