Learning Smooth Humanoid Locomotion through Lipschitz-Constrained Policies

G. Feng, H. Zhang, Z. Li, X. B. Peng, B. Basireddy, L. Yue, Z. Song, L. Yang, Y. Liu, K. Sreenath, et al. , “Genloco: Generalized locomotion controllers for quadrupedal robots,” in Conference on Robot Learning . PMLR, 2023, pp. 1893–1903

1903

Earlier work this paper cites.

J. Lasalle, “The ‘bang-bang’ principle,” IFAC Proceedings Volumes , vol. 1, no. 1, pp. 503–507, 1960, 1st International IFAC Congress on Automatic and Remote Control, Moscow, USSR, 1960. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S147466701770095X

1960

Earlier work this paper cites.

H. Miura and I. Shimoyama, “Dynamic walk of a biped,” The International Journal of Robotics Research , vol. 3, no. 2, pp. 60–74, 1984

1984

Earlier work this paper cites.

T. Flash and N. Hogan, “The coordination of arm movements: an experimentally confirmed mathematical model,” Journal of neuroscience , vol. 5, no. 7, pp. 1688–1703, 1985

1985

Earlier work this paper cites.

H. Geyer, A. Seyfarth, and R. Blickhan, “Positive force feedback in bouncing gaits?” Proceedings of the Royal Society of London. Series B: Biological Sciences , vol. 270, no. 1529, pp. 2173–2183, 2003

2003

Earlier work this paper cites.

M. O’Searcoid, Metric spaces . Springer Science & Business Media, 2006

2006

Earlier work this paper cites.

K. Sreenath, H.-W. Park, I. Poulakakis, and J. W. Grizzle, “A compliant hybrid zero dynamics controller for stable, efficient and fast bipedal walking on mabel,” The International Journal of Robotics Research , vol. 30, no. 9, pp. 1170–1193, 2011

2011

Earlier work this paper cites.

E. Todorov, T. Erez, and Y. Tassa, “Mujoco: A physics engine for model-based control,” in 2012 IEEE/RSJ international conference on intelligent robots and systems . IEEE, 2012, pp. 5026–5033

2012

Earlier work this paper cites.

J. Schulman, S. Levine, P. Moritz, M. I. Jordan, and P. Abbeel, “Trust region policy optimization,” CoRR , vol. abs/1502.05477, 2015. [Online]. Available: http://arxiv.org/abs/1502.05477

Original

2015

Earlier work this paper cites.

M. Arjovsky, S. Chintala, and L. Bottou, “Wasserstein gan,” 2017. [Online]. Available: https://arxiv.org/abs/1701.07875

Original

2017

Earlier work this paper cites.

I. Gulrajani, F. Ahmed, M. Arjovsky, V. Dumoulin, and A. Courville, “Improved training of wasserstein gans,” 2017. [Online]. Available: https://arxiv.org/abs/1704.00028

Original

2017

Earlier work this paper cites.

J. Schulman, F. Wolski, P. Dhariwal, A. Radford, and O. Klimov, “Proximal policy optimization algorithms,” arXiv preprint arXiv:1707.06347 , 2017

Original

2017

Earlier work this paper cites.

X. B. Peng, M. Andrychowicz, W. Zaremba, and P. Abbeel, “Sim-to-real transfer of robotic control with dynamics randomization,” in 2018 IEEE International Conference on Robotics and Automation (ICRA) , May 2018, pp. 1–8

2018

Earlier work this paper cites.

T. Karras, T. Aila, S. Laine, and J. Lehtinen, “Progressive growing of gans for improved quality, stability, and variation,” 2018. [Online]. Available: https://arxiv.org/abs/1710.10196

Original

2018

Earlier work this paper cites.

R. S. Sutton and A. G. Barto, Reinforcement learning: An introduction . MIT press, 2018

2018

Earlier work this paper cites.

A. Brock, J. Donahue, and K. Simonyan, “Large scale gan training for high fidelity natural image synthesis,” 2019. [Online]. Available: https://arxiv.org/abs/1809.11096

Original

2019

Earlier work this paper cites.

X. B. Peng, E. Coumans, T. Zhang, T.-W. Lee, J. Tan, and S. Levine, “Learning agile robotic locomotion skills by imitating animals,” arXiv preprint arXiv:2004.00784 , 2020

Original

2020

Earlier work this paper cites.

Z. Fu, A. Kumar, J. Malik, and D. Pathak, “Minimizing energy consumption leads to the emergence of gaits in legged robots,” in Conference on Robot Learning (CoRL) , 2021

2021

Cited alongside, same era.

Z. Li, X. Cheng, X. B. Peng, P. Abbeel, S. Levine, G. Berseth, and K. Sreenath, “Reinforcement learning for robust parameterized locomotion control of bipedal robots,” in 2021 IEEE International Conference on Robotics and Automation (ICRA) . IEEE, 2021, pp. 2811–2817

2021

Cited alongside, same era.

A. Kumar, Z. Fu, D. Pathak, and J. Malik, “Rma: Rapid motor adaptation for legged robots,” arXiv preprint arXiv:2107.04034 , 2021

Original

2021

Cited alongside, same era.

V. Makoviychuk, L. Wawrzyniak, Y. Guo, M. Lu, K. Storey, M. Macklin, D. Hoeller, N. Rudin, A. Allshire, A. Handa, et al. , “Isaac gym: High performance gpu-based physics simulation for robot learning,” arXiv preprint arXiv:2108.10470 , 2021

Original

2021

Cited alongside, same era.

Y. Ze, Z. Chen, W. Wang, T. Chen, X. He, Y. Yuan, X. B. Peng, and J. Wu, “Generalizable humanoid manipulation with improved 3d diffusion policies,” arXiv preprint arXiv:2410.10803 , 2024

Original

2024

Closest in time.

I. Radosavovic, S. Kamat, T. Darrell, and J. Malik, “Learning humanoid locomotion over challenging terrain,” 2024. [Online]. Available: https://arxiv.org/abs/2410.03654

Original

2024

Closest in time.

F. Liu, Z. Gu, Y. Cai, Z. Zhou, S. Zhao, H. Jung, S. Ha, Y. Chen, D. Xu, and Y. Zhao, “Opt2skill: Imitating dynamically-feasible whole-body trajectories for versatile humanoid loco-manipulation,” arXiv preprint arXiv:2409.20514 , 2024

Original

2024

Closest in time.

X. Cheng, Y. Ji, J. Chen, R. Yang, G. Yang, and X. Wang, “Expressive whole-body control for humanoid robots,” arXiv preprint arXiv:2402.16796 , 2024

Original

2024

Closest in time.