Simulator Predictive Control: Using Learned Task Representations and MPC for Zero-Shot Generalization and Sequencing

N. Jakobi, P. Husbands, and I. Harvey, “Noise and the reality gap: The use of simulation in evolutionary robotics,” in Advances in Artificial Life , F. Morán, A. Moreno, J. J. Merelo, and P. Chacón, Eds. Berlin, Heidelberg: Springer Berlin Heidelberg, 1995, pp. 704–720

1995

Earlier work this paper cites.

S. Barrett, M. E. Taylor, and P. Stone, “Transfer learning for reinforcement learning on a physical robot,” in Ninth International Conference on Autonomous Agents and Multiagent Systems - Adaptive Learning Agents Workshop (AAMAS - ALA) , May 2010. [Online]. Available: http://www.cs.utexas.edu/users/ai-lab/?AAMASWS10-barrett

2010

Earlier work this paper cites.

P. Pastor, M. Kalakrishnan, L. Righetti, and S. Schaal, “Towards associative skill memories,” in Humanoids , Nov 2012

2012

Earlier work this paper cites.

“MuJoCo: A physics engine for model-based control,” in IROS , 2012

2012

Earlier work this paper cites.

D. P. Kingma and M. Welling, “Auto-encoding variational bayes,” CoRR , vol. abs/1312.6114, 2013. [Online]. Available: http://arxiv.org/abs/1312.6114

Original

2013

Earlier work this paper cites.

V. Mnih, K. Kavukcuoglu, D. Silver, A. Rusu, J. Veness, M. Bellemare, A. Graves, M. Riedmiller, A. Fidjeland, G. Ostrovski, S. Petersen, C. Beattie, A. Sadik, I. Antonoglou, H. King, D. Kumaran, D. Wierstra, S. Legg, and D. Hassabis, “Human-level control through deep reinforcement learning,” Nature , vol. 518, no. 7540, pp. 529–533, 2015. [Online]. Available: https://www.nature.com/nature/journal/v518/n7540/pdf/nature1423 6.pdf

2015

Earlier work this paper cites.

E. Rueckert, J. Mundo, A. Paraschos, J. Peters, and G. Neumann, “Extracting low-dimensional control variables for movement primitives,” in ICRA , May 2015

2015

Earlier work this paper cites.

D. Silver, A. Huang, C. J. Maddison, A. Guez, L. Sifre, G. van den Driessche, J. Schrittwieser, I. Antonoglou, V. Panneershelvam, M. Lanctot, S. Dieleman, D. Grewe, J. Nham, N. Kalchbrenner, I. Sutskever, T. P. Lillicrap, M. Leach, K. Kavukcuoglu, T. Graepel, and D. Hassabis, “Mastering the game of go with deep neural networks and tree search,” Nature , vol. 529, no. 7587, pp. 484–489, 2016. [Online]. Available: https://doi.org/10.1038/nature16961

2016

Cited alongside, same era.

A. Yahya, A. Li, M. Kalakrishnan, Y. Chebotar, and S. Levine, “Collective robot reinforcement learning with distributed asynchronous guided policy search,” CoRR , vol. abs/1610.00673, 2016. [Online]. Available: http://arxiv.org/abs/1610.00673

Original

2016

Cited alongside, same era.

X. Peng, M. Andrychowicz, W. Zaremba, and P. Abbeel, “Sim-to-real transfer of robotic control with dynamics randomization,” CoRR , vol. abs/1710.06537, 2017. [Online]. Available: http://arxiv.org/abs/1710.06537

Original

2017

Cited alongside, same era.

J. Schulman, P. Abbeel, and X. Chen, “Equivalence between policy gradients and soft q-learning,” CoRR , vol. abs/1704.06440, 2017. [Online]. Available: http://arxiv.org/abs/1704.06440

J. Schulman, F. Wolski, P. Dhariwal, A. Radford, and O. Klimov, “Proximal policy optimization algorithms,” CoRR , vol. abs/1707.06347, 2017. [Online]. Available: http://arxiv.org/abs/1707.06347

Original

2017

Later among the works it cites.

M. Andrychowicz, F. Wolski, A. Ray, J. Schneider, R. Fong, P. Welinder, B. McGrew, J. Tobin, P. Abbeel, and W. Zaremba, “Hindsight experience replay,” in NIPS , 2017

2017

Later among the works it cites.

K. Hausman, J. Springenberg, Z. Wang, N. Heess, and M. Riedmiller, “Learning an embedding space for transferable robot skills,” in ICLR , 2018. [Online]. Available: https://openreview.net/forum?id=rk07ZXZRb

2018

Closest in time.

R. C. Julian, E. Heiden, Z. He, H. Zhang, S. Schaal, J. Lim, G. S. Sukhatme, and K. Hausman, “Scaling simulation-to-real transfer by learning composable robot skills,” in International Symposium on Experimental Robotics . Springer, 2018. [Online]. Available: https://ryanjulian.me/iser_2018.pdf

2018

Closest in time.