MALMM: Multi-Agent Large Language Models for Zero-Shot Robotics Manipulation

M. Ester, H.-P. Kriegel, J. Sander, X. Xu, et al. , “A density-based algorithm for discovering clusters in large spatial databases with noise,” in kdd , vol. 96, no. 34, 1996, pp. 226–231

1996

Earlier work this paper cites.

T. Kollar, S. Tellex, D. K. Roy, and N. Roy, “Grounding verbs of motion in natural language commands to robots,” in International Symposium on Experimental Robotics , 2010. [Online]. Available: https://api.semanticscholar.org/CorpusID:5821491

2010

Earlier work this paper cites.

J. Thomason, S. Zhang, R. J. Mooney, and P. Stone, “Learning to interpret natural language commands through human-robot dialog,” in International Joint Conference on Artificial Intelligence , 2015. [Online]. Available: https://api.semanticscholar.org/CorpusID:6745034

2015

Earlier work this paper cites.

S. James, Z. Ma, D. R. Arrojo, and A. J. Davison, “Rlbench: The robot learning benchmark & learning environment,” IEEE Robotics and Automation Letters , vol. 5, pp. 3019–3026, 2019. [Online]. Available: https://api.semanticscholar.org/CorpusID:202889132

2019

Earlier work this paper cites.

J. Wei, X. Wang, D. Schuurmans, M. Bosma, E. H. hsin Chi, F. Xia, Q. Le, and D. Zhou, “Chain of thought prompting elicits reasoning in large language models,” ArXiv , vol. abs/2201.11903, 2022. [Online]. Available: https://api.semanticscholar.org/CorpusID:246411621

Original

2022

Earlier work this paper cites.

E. Jang, A. Irpan, M. Khansari, D. Kappler, F. Ebert, C. Lynch, S. Levine, and C. Finn, “Bc-z: Zero-shot task generalization with robotic imitation learning,” ArXiv , vol. abs/2202.02005, 2022. [Online]. Available: https://api.semanticscholar.org/CorpusID:237257594

Original

2022

Earlier work this paper cites.

W. Huang, F. Xia, T. Xiao, H. Chan, J. Liang, P. R. Florence, A. Zeng, J. Tompson, I. Mordatch, Y. Chebotar, P. Sermanet, N. Brown, T. Jackson, L. Luu, S. Levine, K. Hausman, and B. Ichter, “Inner monologue: Embodied reasoning through planning with language models,” in Conference on Robot Learning , 2022. [Online]. Available: https://api.semanticscholar.org/CorpusID:250451569

2022

Earlier work this paper cites.

J. Liang, W. Huang, F. Xia, P. Xu, K. Hausman, B. Ichter, P. R. Florence, and A. Zeng, “Code as policies: Language model programs for embodied control,” 2023 IEEE International Conference on Robotics and Automation (ICRA) , pp. 9493–9500, 2022. [Online]. Available: https://api.semanticscholar.org/CorpusID:252355542

2022

Earlier work this paper cites.

C. Huang, O. Mees, A. Zeng, and W. Burgard, “Visual language maps for robot navigation,” 2023 IEEE International Conference on Robotics and Automation (ICRA) , pp. 10 608–10 615, 2022. [Online]. Available: https://api.semanticscholar.org/CorpusID:252846548

2022

Earlier work this paper cites.

W. Huang, P. Abbeel, D. Pathak, and I. Mordatch, “Language models as zero-shot planners: Extracting actionable knowledge for embodied agents,” ArXiv , vol. abs/2201.07207, 2022. [Online]. Available: https://api.semanticscholar.org/CorpusID:246035276

Original

2022

Earlier work this paper cites.

W. Chen, X. Ma, X. Wang, and W. W. Cohen, “Program of thoughts prompting: Disentangling computation from reasoning for numerical reasoning tasks,” arXiv preprint arXiv:2211.12588 , 2022

Original

2022

Earlier work this paper cites.

A. Goyal, J. Xu, Y. Guo, V. Blukis, Y.-W. Chao, and D. Fox, “Rvt: Robotic view transformer for 3d object manipulation,” arXiv preprint arXiv:2306.14896 , 2023

Original

2023

Earlier work this paper cites.

T. Gervet, Z. Xian, N. Gkanatsios, and K. Fragkiadaki, “Act3d: 3d feature field transformers for multi-task robotic manipulation,” in Conference on Robot Learning . PMLR, 2023, pp. 3949–3965

2023

Cited alongside, same era.

T. Kwon, N. D. Palo, and E. Johns, “Language models as zero-shot trajectory generators,” IEEE Robotics and Automation Letters , vol. 9, pp. 6728–6735, 2023. [Online]. Available: https://api.semanticscholar.org/CorpusID:264289016

2023

Cited alongside, same era.

B. Liu, Y. Jiang, X. Zhang, Q. Liu, S. Zhang, J. Biswas, and P. Stone, “Llm+ p: Empowering large language models with optimal planning proficiency,” arXiv preprint arXiv:2304.11477 , 2023

Original

2023

Cited alongside, same era.

Z. Liu, A. Bahety, and S. Song, “Reflect: Summarizing robot experiences for failure explanation and correction,” ArXiv , vol. abs/2306.15724, 2023. [Online]. Available: https://api.semanticscholar.org/CorpusID:259274760

Original

2023

Cited alongside, same era.

OpenAI, “GPT-4 technical report,” 2023

2023

Later among the works it cites.

Q. Wu, G. Bansal, J. Zhang, Y. Wu, B. Li, E. Zhu, L. Jiang, X. Zhang, S. Zhang, J. Liu, A. H. Awadallah, R. W. White, D. Burger, and C. Wang, “Autogen: Enabling next-gen llm applications via multi-agent conversation,” 2023. [Online]. Available: https://api.semanticscholar.org/CorpusID:263611068

2023

Later among the works it cites.

J. Elsner, “Taming the panda with python: A powerful duo for seamless robotics programming and integration,” SoftwareX , vol. 24, p. 101532, 2023. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S2352711023002285

2023

Later among the works it cites.

J. Gao, B. Sarkar, F. Xia, T. Xiao, J. Wu, B. Ichter, A. Majumdar, and D. Sadigh, “Physically grounded vision-language models for robotic manipulation,” in 2024 IEEE International Conference on Robotics and Automation (ICRA) . IEEE, 2024, pp. 12 462–12 469

2024

Closest in time.