VQ-ACE: Efficient Policy Search for Dexterous Robotic Manipulation via Action Chunking Embedding

P. Dhariwal, H. Jun, C. Payne, J. W. Kim, A. Radford, and I. Sutskever, “Jukebox: A generative model for music,” CoRR , vol. abs/2005.00341, 2020. [Online]. Available: https://arxiv.org/abs/2005.00341

Original

2005

Earlier work this paper cites.

A. van den Oord, O. Vinyals, and K. Kavukcuoglu, “Neural discrete representation learning,” in Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, December 4-9, 2017, Long Beach, CA, USA , I. Guyon, U. von Luxburg, S. Bengio, H. M. Wallach, R. Fergus, S. V. N. Vishwanathan, and R. Garnett, Eds., 2017, pp. 6306–6315. [Online]. Available: https://proceedings.neurips.cc/paper/2017/hash/7a98af17e63a0ac09ce2e96d03992fbc-Abstract.html

2017

Earlier work this paper cites.

J. Schulman, F. Wolski, P. Dhariwal, A. Radford, and O. Klimov, “Proximal policy optimization algorithms,” CoRR , vol. abs/1707.06347, 2017. [Online]. Available: http://arxiv.org/abs/1707.06347

Original

2017

Earlier work this paper cites.

OpenAI, M. Andrychowicz, B. Baker, M. Chociej, R. Józefowicz, B. McGrew, J. Pachocki, A. Petron, M. Plappert, G. Powell, A. Ray, J. Schneider, S. Sidor, J. Tobin, P. Welinder, L. Weng, and W. Zaremba, “Learning dexterous in-hand manipulation,” CoRR , vol. abs/1808.00177, 2018. [Online]. Available: http://arxiv.org/abs/1808.00177

Original

2018

Earlier work this paper cites.

J. Devlin, M.-W. Chang, K. Lee, and K. Toutanova, “Bert: Pre-training of deep bidirectional transformers for language understanding,” 2019. [Online]. Available: https://arxiv.org/abs/1810.04805

Original

2019

Earlier work this paper cites.

C. Yang, B. Zhang, J. Zeng, A. Agrawal, and K. Sreenath, “Dynamic legged manipulation of a ball through multi-contact optimization,” in IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2020, Las Vegas, NV, USA, October 24, 2020 - January 24, 2021 . IEEE, 2020, pp. 7513–7520. [Online]. Available: https://doi.org/10.1109/IROS45743.2020.9341218

2020

Earlier work this paper cites.

K. L. Poggensee, A. H. Li, D. Sotsaikich, B. Zhang, P. Kotaru, M. W. Mueller, and K. Sreenath, “Ball juggling on the bipedal robot cassie,” in 18th European Control Conference, ECC 2020, Virtual Event, Russia, May 12-15, 2020 . IEEE, 2020, pp. 875–880. [Online]. Available: https://ieeexplore.ieee.org/document/9143967

2020

Earlier work this paper cites.

D. Lee, H. Seo, D. Kim, and H. J. Kim, “Aerial manipulation using model predictive control for opening a hinged door,” in 2020 IEEE International Conference on Robotics and Automation, ICRA 2020, Paris, France, May 31 - August 31, 2020 . IEEE, 2020, pp. 1237–1242. [Online]. Available: https://doi.org/10.1109/ICRA40945.2020.9197524

2020

Earlier work this paper cites.

N. Rudin, D. Hoeller, P. Reist, and M. Hutter, “Learning to walk in minutes using massively parallel deep reinforcement learning,” in Conference on Robot Learning, 8-11 November 2021, London, UK , ser. Proceedings of Machine Learning Research, A. Faust, D. Hsu, and G. Neumann, Eds., vol. 164. PMLR, 2021, pp. 91–100. [Online]. Available: https://proceedings.mlr.press/v164/rudin22a.html

2021

Earlier work this paper cites.

R. Rombach, A. Blattmann, D. Lorenz, P. Esser, and B. Ommer, “High-resolution image synthesis with latent diffusion models,” CoRR , vol. abs/2112.10752, 2021. [Online]. Available: https://arxiv.org/abs/2112.10752

Original

2021

Earlier work this paper cites.

A. Radford, J. W. Kim, C. Hallacy, A. Ramesh, G. Goh, S. Agarwal, G. Sastry, A. Askell, P. Mishkin, J. Clark, G. Krueger, and I. Sutskever, “Learning transferable visual models from natural language supervision,” CoRR , vol. abs/2103.00020, 2021. [Online]. Available: https://arxiv.org/abs/2103.00020

Original

2021

Earlier work this paper cites.

R. Rombach, A. Blattmann, D. Lorenz, P. Esser, and B. Ommer, “High-resolution image synthesis with latent diffusion models,” CoRR , vol. abs/2112.10752, 2021. [Online]. Available: https://arxiv.org/abs/2112.10752

Original

2021

Earlier work this paper cites.

S. Pateria, B. Subagdja, A.-h. Tan, and C. Quek, “Hierarchical reinforcement learning: A comprehensive survey,” ACM Comput. Surv. , vol. 54, no. 5, jun 2021. [Online]. Available: https://doi.org/10.1145/3453160

2021

Earlier work this paper cites.

T. Howell, N. Gileadi, S. Tunyasuvunakool, K. Zakka, T. Erez, and Y. Tassa, “Predictive sampling: Real-time behaviour synthesis with mujoco,” CoRR , vol. abs/2212.00541, 2022. [Online]. Available: https://doi.org/10.48550/arXiv.2212.00541

Original

2022

Earlier work this paper cites.

A. Ramesh, P. Dhariwal, A. Nichol, C. Chu, and M. Chen, “Hierarchical text-conditional image generation with CLIP latents,” CoRR , vol. abs/2204.06125, 2022. [Online]. Available: https://doi.org/10.48550/arXiv.2204.06125

Original

2022

Cited alongside, same era.

N. M. Shafiullah, Z. J. Cui, A. Altanzaya, and L. Pinto, “Behavior transformers: Cloning $k$ modes with one stone,” in Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, NeurIPS 2022, New Orleans, LA, USA, November 28 - December 9, 2022 , S. Koyejo, S. Mohamed, A. Agarwal, D. Belgrave, K. Cho, and A. Oh, Eds., 2022. [Online]. Available: http://papers.nips.cc/paper_files/paper/2022/hash/90d17e882adbdda42349db6f50123817-Abstract-Conference.html

2022

Cited alongside, same era.

N. M. M. Shafiullah, Z. J. Cui, A. Altanzaya, and L. Pinto, “Behavior transformers: Cloning $k$ modes with one stone,” in Advances in Neural Information Processing Systems , A. H. Oh, A. Agarwal, D. Belgrave, and K. Cho, Eds., 2022. [Online]. Available: https://openreview.net/forum?id=agTr-vRQsa

2022

Cited alongside, same era.

A. Lakshmipathy and N. S. Pollard, “ContactMPC: Towards online adaptive control for contact-rich dexterous manipulation,” in 2nd Workshop on Dexterous Manipulation: Design, Perception and Control (RSS) , 2024. [Online]. Available: https://openreview.net/forum?id=d8qYLDH2vj

2024

Closest in time.

Y. Liu, Y. Yang, Y. Wang, X. Wu, J. Wang, Y. Yao, S. Schwertfeger, S. Yang, W. Wang, J. Yu, X. He, and Y. Ma, “Realdex: Towards human-like grasping for robotic dexterous hand,” CoRR , vol. abs/2402.13853, 2024. [Online]. Available: https://doi.org/10.48550/arXiv.2402.13853

Original

2024

Closest in time.

H. Zhang, S. J. Christen, Z. Fan, O. Hilliges, and J. Song, “Graspxl: Generating grasping motions for diverse objects at scale,” CoRR , vol. abs/2403.19649, 2024. [Online]. Available: https://doi.org/10.48550/arXiv.2403.19649

Original

2024

Closest in time.

V. D. An, M. N. Vu, H. Le, B. Huang, H. T. T. Binh, T. Vo, A. Kugi, and A. Nguyen, “Grasp-anything: Large-scale grasp dataset from foundation models,” in IEEE International Conference on Robotics and Automation, ICRA 2024, Yokohama, Japan, May 13-17, 2024 . IEEE, 2024, pp. 14 030–14 037. [Online]. Available: https://doi.org/10.1109/ICRA57147.2024.10611277