Improving generalization of robot locomotion policies via Sharpness-Aware Reinforcement Learning

J. Hwangbo, J. Lee, Dosovitskiy et al. , “Learning agile and dynamic motor skills for legged robots,” CoRR , 2019. [Online]. Available: http://arxiv.org/abs/1901.08652

Original

1901

Earlier work this paper cites.

S. Hochreiter and J. Schmidhuber, “Long short-term memory,” Neural Comput. , 1997. [Online]. Available: https://doi.org/10.1162/neco.1997.9.8.1735

1997

Earlier work this paper cites.

M. Geilinger, D. Hahn, J. Zehnder, M. Bächer, B. Thomaszewski, and S. Coros, “Add: Analytically differentiable dynamics for multi-body systems with frictional contact,” 2020. [Online]. Available: https://arxiv.org/abs/2007.00987

Original

2007

Earlier work this paper cites.

P. Foret, A. Kleiner, H. Mobahi, and B. Neyshabur, “Sharpness-Aware Minimization for Efficiently Improving Generalization,” Apr. 2021, arXiv:2010.01412 [cs, stat]. [Online]. Available: http://arxiv.org/abs/2010.01412

Original

2010

Earlier work this paper cites.

E. Todorov, T. Erez, and Y. Tassa, “Mujoco: A physics engine for model-based control,” in 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems , 2012, pp. 5026–5033

2012

Earlier work this paper cites.

J. Tobin, R. Fong, A. Ray, J. Schneider, W. Zaremba, and P. Abbeel, “Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real World,” Mar. 2017. [Online]. Available: http://arxiv.org/abs/1703.06907

Original

2017

Earlier work this paper cites.

N. S. Keskar, D. Mudigere, J. Nocedal, M. Smelyanskiy, and P. T. P. Tang, “On large-batch training for deep learning: Generalization gap and sharp minima,” 2017. [Online]. Available: https://arxiv.org/abs/1609.04836

Original

2017

Earlier work this paper cites.

J. Schulman, F. Wolski, P. Dhariwal, A. Radford, and O. Klimov, “Proximal policy optimization algorithms,” 2017

2017

Earlier work this paper cites.

D. P. Kingma and J. Ba, “Adam: A method for stochastic optimization,” 2017. [Online]. Available: https://arxiv.org/abs/1412.6980

Original

2017

Earlier work this paper cites.

J. Tan, T. Zhang, E. Coumans, A. Iscen, Y. Bai, D. Hafner, S. Bohez, and V. Vanhoucke, “Sim-to-real: Learning agile locomotion for quadruped robots,” 2018. [Online]. Available: https://arxiv.org/abs/1804.10332

Original

2018

Cited alongside, same era.

A. O. Onol, P. Long, and T. Padlr, “A comparative analysis of contact models in trajectory optimization for manipulation,” in 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) , 2018, pp. 1–9

2018

Cited alongside, same era.

M. Andrychowicz, B. Baker, M. Chociej et al. , “Learning dexterous in-hand manipulation,” 2019. [Online]. Available: https://arxiv.org/abs/1808.00177

Original

2019

Cited alongside, same era.

M. A. Z. Mora, M. Peychev, S. Ha, M. Vechev, and S. Coros, “Pods: Policy optimization via differentiable simulation,” in Proceedings of the 38th International Conference on Machine Learning , ser. Proceedings of Machine Learning Research, M. Meila and T. Zhang, Eds., vol. 139. PMLR, 18–24 Jul 2021, pp. 7805–7817. [Online]. Available: https://proceedings.mlr.press/v139/mora21a.html

H. J. Suh, M. Simchowitz, K. Zhang, and R. Tedrake, “Do differentiable simulators give better policy gradients?” in Proceedings of the 39th International Conference on Machine Learning , ser. Proceedings of Machine Learning Research, K. Chaudhuri, S. Jegelka, L. Song, C. Szepesvari, G. Niu, and S. Sabato, Eds., vol. 162. PMLR, 17–23 Jul 2022, pp. 20 668–20 696. [Online]. Available: https://proceedings.mlr.press/v162/suh22b.html

2022

Later among the works it cites.

J. Xu, V. Makoviychuk, Y. Narang, F. Ramos, W. Matusik, A. Garg, and M. Macklin, “Accelerated policy learning with parallel differentiable simulation,” 2022

2022

Later among the works it cites.

J. Du, H. Yan, J. Feng, J. T. Zhou, L. Zhen, R. S. M. Goh, and V. Tan, “Efficient sharpness-aware minimization for improved training of neural networks,” in International Conference on Learning Representations , 2022. [Online]. Available: https://openreview.net/forum?id=n0OeTdNRG0Q

2022

Later among the works it cites.