Sim-to-Real Transfer Learning using Robustified Controllers in Robotic Tasks involving Complex Dynamics

R. J. Williams, “Simple statistical gradient-following algorithms for connectionist reinforcement learning,” Machine Learning , vol. 8, no. 3-4, May 1992

1992

Earlier work this paper cites.

R. S. Sutton and A. G. Barto, Introduction to Reinforcement Learning , 1st ed. Cambridge, MA, USA: MIT Press, 1998

1998

Earlier work this paper cites.

Y. Bengio, J. Louradour, R. Collobert, and J. Weston, “Curriculum learning,” in International Conference on Machine Learning (ICML , 2009

2009

Earlier work this paper cites.

A. S. Razavian, H. Azizpour, J. Sullivan, and S. Carlsson, “CNN features off-the-shelf: an astounding baseline for recognition,” Computer Vision and Pattern Recognition (CVPR) , 2014

2014

Earlier work this paper cites.

J. Yosinski, J. Clune, Y. Bengio, and H. Lipson, “How transferable are features in deep neural networks?” Advances in Neural Information Processing Systems (NIPS) , 2014

2014

Earlier work this paper cites.

E. Todorov, “Convex and analytically-invertible dynamics with contacts and constraints: Theory and implementation in mujoco,” IEEE International Conference on Robotics and Automation (ICRA) , 2014

2014

Earlier work this paper cites.

V. Mnih, K. Kavukcuoglu, D. Silver, A. A. Rusu, J. Veness, M. G. Bellemare, A. Graves, M. Riedmiller, A. K. Fidjeland, G. Ostrovski, S. Petersen, C. Beattie, A. Sadik, I. Antonoglou, H. King, D. Kumaran, D. Wierstra, S. Legg, and D. Hassabis, “Human-level control through deep reinforcement learning,” Nature , vol. 518, no. 7540, pp. 529–533, Feb. 2015. [Online]. Available: http://dx.doi.org/10.1038/nature14236

2015

Earlier work this paper cites.

J. Wu, I. Yildirim, J. J. Lim, B. Freeman, and J. Tenenbaum, “Galileo: Perceiving physical object properties by integrating a physics engine with deep learning,” Advances in Neural Information Processing Systems (NIPS) , 2015

2015

Earlier work this paper cites.

T. P. Lillicrap, J. J. Hunt, A. Pritzel, N. Heess, T. Erez, Y. Tassa, D. Silver, and D. Wierstra, “Continuous control with deep reinforcement learning,” International Conference on Learning Representations (ICLR) , 2015

2015

Earlier work this paper cites.

V. Mnih, A. P. Badia, M. Mirza, A. Graves, T. P. Lillicrap, T. Harley, D. Silver, and K. Kavukcuoglu, “Asynchronous methods for deep reinforcement learning,” CoRR , vol. abs/1602.01783, 2016. [Online]. Available: http://arxiv.org/abs/1602.01783

Original

2016

Earlier work this paper cites.

D. Silver, A. Huang, C. J. Maddison, A. Guez, L. Sifre, G. van den Driessche, J. Schrittwieser, I. Antonoglou, V. Panneershelvam, M. Lanctot, S. Dieleman, D. Grewe, J. Nham, N. Kalchbrenner, I. Sutskever, T. Lillicrap, M. Leach, K. Kavukcuoglu, T. Graepel, and D. Hassabis, “Mastering the game of Go with deep neural networks and tree search,” Nature , vol. 529, no. 7587, pp. 484–489, Jan. 2016

2016

Earlier work this paper cites.

A. A. Rusu, M. Vecerik, T. Rothörl, N. Heess, R. Pascanu, and R. Hadsell, “Sim-to-real robot learning from pixels with progressive nets,” arXiv preprint , vol. arXiv/1610.04286, 2016

2016

Earlier work this paper cites.

F. Zhang, J. Leitner, B. Upcroft, and P. I. Corke, “Vision-based reaching using modular deep networks: from simulation to the real world,” arXiv preprint , vol. arXiv:1610.06781, 2016. [Online]. Available: http://arxiv.org/abs/1610.06781

Original

2016

Cited alongside, same era.

A. Shrivastava, T. Pfister, O. Tuzel, J. Susskind, W. Wang, and R. Webb, “Learning from simulated and unsupervised images through adversarial training,” Computer Vision and Pattern Recognition (CVPR) , 2016

2016

Cited alongside, same era.

P. F. Christiano, Z. Shah, I. Mordatch, J. Schneider, T. Blackwell, J. Tobin, P. Abbeel, and W. Zaremba, “Transfer from simulation to real world through learning deep inverse dynamics model,” arXiv preprint , vol. arXiv/1610.03518, 2016

2016

Cited alongside, same era.

F. Sadeghi and S. Levine, “(cad)$ˆ2$rl: Real single-image flight without a single real image,” Robotics: Science and Systems Conference (RSS) , 2016

2016

Cited alongside, same era.

S. James, A. J. Davison, and E. Johns, “Transferring end-to-end visuomotor control from simulation to real world for a multi-stage task,” Conference on Robot Learning (CoRL) , 2017

2017

Later among the works it cites.

C. Finn, P. Abbeel, and S. Levine, “Model-agnostic meta-learning for fast adaptation of deep networks,” ICML 2017 , vol. abs/1703.03400, 2017. [Online]. Available: http://arxiv.org/abs/1703.03400

Original

2017

Later among the works it cites.

L. Pinto, M. Andrychowicz, P. Welinder, W. Zaremba, and P. Abbeel, “Asymmetric actor critic for image-based robot learning,” CoRR , vol. abs/1710.06542, 2017. [Online]. Available: http://arxiv.org/abs/1710.06542

Original

2017

Later among the works it cites.

J. Fu, K. Luo, and S. Levine, “Learning robust rewards with adversarial inverse reinforcement learning,” CoRR , vol. abs/1710.11248, 2017. [Online]. Available: http://arxiv.org/abs/1710.11248

Original

2017

Later among the works it cites.