Designing Interpretable Approximations to Deep Reinforcement Learning

Improved Knowledge Distillation via Teacher Assistant

Original

Mirzadeh, S.-I.; Farajtabar, M.; Li, A.; Levine, N.; Matsukawa, A.; and Ghasemzadeh, H. 2019 · 1902

Earlier work this paper cites.

Neuronlike adaptive elements that can solve difficult learning control problems

Barto, A. G.; Sutton, R. S.; and Anderson, C. W. 1983 · 1983

Earlier work this paper cites.

Efficient memory-based learning for robot control

Moore, A. W. 1990 · 1990

Earlier work this paper cites.

Survey and critique of techniques for extracting rules from trained artificial neural networks

Andrews, R.; Diederich, J.; and Tickle, A. B. 1995 · 1995

Earlier work this paper cites.

Learning to use selective attention and short-term memory in sequential tasks

McCallum, A. K.; et al. 1996 · 1996

Earlier work this paper cites.

Model compression

Buciluǎ, C.; Caruana, R.; and Niculescu-Mizil, A. 2006 · 2006

Earlier work this paper cites.

Logistic model tree extraction from artificial neural networks

Dancey, D.; Bandar, Z. A.; and McLean, D. 2007 · 2007

Earlier work this paper cites.

Scikit-learn: Machine Learning in Python

Pedregosa, F.; Varoquaux, G.; Gramfort, A.; Michel, V.; Thirion, B.; Grisel, O.; Blondel, M.; Prettenhofer, P.; Weiss, R.; Dubourg, V.; Vanderplas, J.; Passos, A.; Cournapeau, D.; Brucher, M.; Perrot, M.; and Duchesnay, E. 2011 · 2011

Earlier work this paper cites.

A reduction of imitation learning and structured prediction to no-regret online learning

Ross, S.; Gordon, G.; and Bagnell, D. 2011 · 2011

Earlier work this paper cites.

Playing atari with deep reinforcement learning

Original

Mnih, V.; Kavukcuoglu, K.; Silver, D.; Graves, A.; Antonoglou, I.; Wierstra, D.; and Riedmiller, M. 2013 · 2013

Cited alongside, same era.

Do deep nets really need to be deep?

Ba, J.; and Caruana, R. 2014 · 2014

Cited alongside, same era.

Distilling the knowledge in a neural network

Original

Hinton, G.; Vinyals, O.; and Dean, J. 2015 · 2015

Cited alongside, same era.

Policy distillation

Original

Rusu, A. A.; Colmenarejo, S. G.; Gulcehre, C.; Desjardins, G.; Kirkpatrick, J.; Pascanu, R.; Mnih, V.; Kavukcuoglu, K.; and Hadsell, R. 2015 · 2015

Cited alongside, same era.

Interpretability via model extraction

Original

Bastani, O.; Kim, C.; and Bastani, H. 2017 · 2017

Verifiable reinforcement learning via policy extraction

Bastani, O.; Pu, Y.; and Solar-Lezama, A. 2018 · 2018

Later among the works it cites.

Toward interpretable deep reinforcement learning with linear model u-trees

Liu, G.; Schulte, O.; Zhu, W.; and Li, Q. 2018 · 2018

Later among the works it cites.

Model compression via distillation and quantization

Original

Polino, A.; Pascanu, R.; and Alistarh, D. 2018 · 2018

Later among the works it cites.

Kickstarting deep reinforcement learning

Original

Schmitt, S.; Hudson, J. J.; Zidek, A.; Osindero, S.; Doersch, C.; Czarnecki, W. M.; Leibo, J. Z.; Kuttler, H.; Zisserman, A.; Simonyan, K.; et al. 2018 · 2018

Later among the works it cites.

Distilling deep reinforcement learning policies in soft decision trees

Coppens, Y.; Efthymiadis, K.; Lenaerts, T.; and Nowe, A. 2019 · 2019

Later among the works it cites.