Causal Counterfactuals for Improving the Robustness of Reinforcement Learning

Models, reasoning and inference

Judea Pearl et al · 2000

Earlier work this paper cites.

Deep Learning

Ian Goodfellow, Yoshua Bengio, and Aaron Courville. 2016 · 2016

Earlier work this paper cites.

Soft actor-critic: Off-policy maximum entropy deep reinforcement learning with a stochastic actor. In International conference on machine learning . PMLR, 1861–1870

Tuomas Haarnoja, Aurick Zhou, Pieter Abbeel, and Sergey Levine. 2018 · 2018

Earlier work this paper cites.

Structural Causal Bandits: Where to Intervene?. In Advances in Neural Information Processing Systems 31 , S. Bengio, H. Wallach, H. Larochelle, K. Grauman, N. Cesa-Bianchi, and R. Garnett (Eds.). Curran Associates, Inc., Montreal, Canada, 2568–2578

S. Lee and E. Bareinboim. 2018 · 2018

Earlier work this paper cites.

Reinforcement learning: An introduction

Richard S Sutton and Andrew G Barto. 2018 · 2018

Earlier work this paper cites.

Causal Reasoning from Meta-reinforcement Learning

Original

Ishita Dasgupta, Jane X. Wang, Silvia Chiappa, Jovana Mitrovic, Pedro A. Ortega, David Raposo, Edward Hughes, Peter W. Battaglia, Matthew M. Botvinick, and Zeb Kurth-Nelson. 2019 · 2019

Earlier work this paper cites.

Learning Neural Causal Models from Unknown Interventions

Original

Nan Rosemary Ke, Olexa Bilaniuk, Anirudh Goyal, Stefan Bauer, H. Larochelle, Chris Pal, and Yoshua Bengio. 2019 · 2019

Earlier work this paper cites.

COPHY: Counterfactual Learning of Physical Dynamics

Original

Fabien Baradel, Natalia Neverova, Julien Mille, Greg Mori, and Christian Wolf. 2020 · 2020

Earlier work this paper cites.

On Pearl’s Hierarchy and the Foundations of Causal Inference

E. Bareinboim, J. Correa, D. Ibeling, and T. Icard. 2020 · 2020

Cited alongside, same era.

Causes and explanations: A structural-model approach. Part I: Causes

Joseph Y Halpern and Judea Pearl. 2020 · 2020

Cited alongside, same era.

Deep Reinforcement Learning for Intelligent Transportation Systems: A Survey

Ammar Haydari and Yasin Yılmaz. 2022 · 2020

Cited alongside, same era.

Offline Learning of Counterfactual Perception as Prediction for Real-World Robotic Reinforcement Learning

Original

Jun Jin, Daniel Graves, Cameron Haigh, Jun Luo, and Martin Jägersand. 2020 · 2020

Cited alongside, same era.

Explainable Reinforcement Learning Through a Causal Lens

Original

Prashan Madumal, Tim Miller, Liz Sonenberg, and Frank Vetere. 2020 · 2020

Cited alongside, same era.

CausalWorld: A Robotic Manipulation Benchmark for Causal Structure and Transfer Learning

Original

Ossama Ahmed, Frederik Trauble, Anirudh Goyal, Alexander Neitz, Manuel Wuthrich, Yoshua Bengio, Bernhard Scholkopf, and Stefan Bauer. 2021 · 2021

Later among the works it cites.

Explainable robotic systems: understanding goal-driven actions in a reinforcement learning scenario

Francisco Cruz, Richard Dazeley, Peter Vamplew, and Ithan Moreira. 2021 · 2021

Later among the works it cites.

Explainable reinforcement learning for Broad-XAI: a conceptual framework and survey

Original

Richard Dazeley, Peter Vamplew, and Francisco Cruz. 2021 · 2021

Later among the works it cites.

Toward Causal Representation Learning

Bernhard Scholkopf, Francesco Locatello, Stefan Bauer, Nan Rosemary Ke, Nal Kalchbrenner, Anirudh Goyal, and Yoshua Bengio. 2021 · 2021

Later among the works it cites.

Causal Curiosity: RL Agents Discovering Self-supervised Experiments for Causal Representation Learning. In ICML