How to pick the domain randomization parameters for sim-to-real transfer of reinforcement learning policies?

J. Hwangbo, J. Lee, A. Dosovitskiy, D. Bellicoso, V. Tsounis, V. Koltun, and M. Hutter, “Learning agile and dynamic motor skills for legged robots,” CoRR , vol. abs/1901.08652, 2019. [Online]. Available: http://arxiv.org/abs/1901.08652

Original

1901

Earlier work this paper cites.

K. Choromanski, A. Pacchiano, J. Parker-Holder, J. Hsu, A. Iscen, D. Jain, and V. Sindhwani, “When random search is not enough: Sample-efficient and noise-robust blackbox optimization of rl policies,” 2019. [Online]. Available: https://arxiv.org/abs/1903.02993

Original

1903

Earlier work this paper cites.

W. Yu, V. C. Kumar, G. Turk, and C. K. Liu, “Sim-to-real transfer for biped locomotion,” 2019. [Online]. Available: https://arxiv.org/abs/1903.01390

Original

1903

Earlier work this paper cites.

K. Kandasamy, K. R. Vysyaraju, W. Neiswanger, B. Paria, C. R. Collins, J. Schneider, B. Poczos, and E. P. Xing, “Tuning hyperparameters without grad students: Scalable and robust bayesian optimisation with dragonfly,” CoRR , 2019. [Online]. Available: https://arxiv.org/abs/1903.06694

Original

1903

Earlier work this paper cites.

D. P. Kingma and M. Welling, “Auto-Encoding Variational Bayes,” 12 2013. [Online]. Available: http://arxiv.org/abs/1312.6114

Original

2013

Earlier work this paper cites.

D. J. Rezende, S. Mohamed, and D. Wierstra, “Stochastic backpropagation and approximate inference in deep generative models,” in Proceedings of the 31st International Conference on Machine Learning , ser. Proceedings of Machine Learning Research, E. P. Xing and T. Jebara, Eds., vol. 32, no. 2. PMLR, 22–24 Jun 2014, pp. 1278–1286

2014

Earlier work this paper cites.

J. Schulman, S. Levine, P. Moritz, M. I. Jordan, and P. Abbeel, “Trust region policy optimization,” CoRR , vol. abs/1502.05477, 2015. [Online]. Available: http://arxiv.org/abs/1502.05477

Original

2015

Earlier work this paper cites.

D. P. Kingma, T. Salimans, R. Jozefowicz, X. Chen, I. Sutskever, and M. Welling, “Improved variational inference with inverse autoregressive flow,” in Advances in neural information processing systems , 2016, pp. 4743–4751

2016

Earlier work this paper cites.

I. Loshchilov and F. Hutter, “Cma-es for hyperparameter optimization of deep neural networks,” CoRR , vol. abs/1604.07269, 2016. [Online]. Available: http://arxiv.org/abs/1604.07269

Original

2016

Earlier work this paper cites.

S. Gu, E. Holly, T. P. Lillicrap, and S. Levine, “Deep reinforcement learning for robotic manipulation,” CoRR , vol. abs/1610.00633, 2016. [Online]. Available: http://arxiv.org/abs/1610.00633

Original

2016

Earlier work this paper cites.

J. Tobin, R. Fong, A. Ray, J. Schneider, W. Zaremba, and P. Abbeel, “Domain randomization for transferring deep neural networks from simulation to the real world,” CoRR , vol. abs/1703.06907, 2017. [Online]. Available: http://arxiv.org/abs/1703.06907

Original

2017

Earlier work this paper cites.

X. B. Peng, M. Andrychowicz, W. Zaremba, and P. Abbeel, “Sim-to-real transfer of robotic control with dynamics randomization,” CoRR , vol. abs/1710.06537, 2017. [Online]. Available: http://arxiv.org/abs/1710.06537

Original

2017

Earlier work this paper cites.

A. Rajeswaran, K. Lowrey, E. Todorov, and S. Kakade, “Towards generalization and simplicity in continuous control,” CoRR , vol. abs/1703.02660, 2017. [Online]. Available: http://arxiv.org/abs/1703.02660

Original

2017

Cited alongside, same era.

J. Schulman, F. Wolski, P. Dhariwal, A. Radford, and O. Klimov, “Proximal policy optimization algorithms,” CoRR , vol. abs/1707.06347, 2017. [Online]. Available: http://arxiv.org/abs/1707.06347

Original

2017

Cited alongside, same era.

M. Zhang, X. Geng, J. Bruce, K. Caluwaerts, M. Vespignani, V. SunSpiral, P. Abbeel, and S. Levine, “Deep reinforcement learning for tensegrity robot locomotion,” in 2017 IEEE International Conference on Robotics and Automation (ICRA) , May 2017, pp. 634–641

2017

Cited alongside, same era.

G. Papamakarios, T. Pavlakou, and I. Murray, “Masked autoregressive flow for density estimation,” in Advances in Neural Information Processing Systems , 2017, pp. 2338–2347

2017

Cited alongside, same era.

J. Tan, T. Zhang, E. Coumans, A. Iscen, Y. Bai, D. Hafner, S. Bohez, and V. Vanhoucke, “Sim-to-real: Learning agile locomotion for quadruped robots,” CoRR , vol. abs/1804.10332, 2018. [Online]. Available: http://arxiv.org/abs/1804.10332

Original

2018

Later among the works it cites.

W. Yu, C. K. Liu, and G. Turk, “Policy transfer with strategy optimization,” CoRR , vol. abs/1810.05751, 2018. [Online]. Available: http://arxiv.org/abs/1810.05751

Original

2018

Later among the works it cites.

OpenAI, M. Andrychowicz, B. Baker, M. Chociej, R. Józefowicz, B. McGrew, J. W. Pachocki, J. Pachocki, A. Petron, M. Plappert, G. Powell, A. Ray, J. Schneider, S. Sidor, J. Tobin, P. Welinder, L. Weng, and W. Zaremba, “Learning dexterous in-hand manipulation,” CoRR , vol. abs/1808.00177, 2018. [Online]. Available: http://arxiv.org/abs/1808.00177

Original

2018

Later among the works it cites.

S. James, P. Wohlhart, M. Kalakrishnan, D. Kalashnikov, A. Irpan, J. Ibarz, S. Levine, R. Hadsell, and K. Bousmalis, “Sim-to-real via sim-to-sim: Data-efficient robotic grasping via randomized-to-canonical adaptation networks,” CoRR , vol. abs/1812.07252, 2018. [Online]. Available: http://arxiv.org/abs/1812.07252