Fetching the paper…
Reading the bibliography…
Recent advancements in robot control using large language models (LLMs) have demonstrated significant potential, primarily due to LLMs' capabilities to understand natural language commands and generate executable plans in various languages.
Natural language processing for unmanned aerial vehicle guidance interfaces. In Massachusetts Institute of Technology
Emily Marie Craparo. 2004 · 2004
Earlier work this paper cites.
Real-time planning for automated multi-view drone cinematography. In ACM Transactions on Graphics
Tobias Nägeli, Lukas Meier, Alexander Domahidi, Javier Alonso-Mora, and Otmar Hilliges. 2017 · 2017
Earlier work this paper cites.
Learning to Map Natural Language Instructions to Physical Quadcopter Control Using Simulated Flight. In Proceedings of the Conference on Robot Learning
Valts Blukis, Yannick Terme, Eyvind Niklasson, Ross A Knepper, and Yoav Artzi. 2019 · 2019
Earlier work this paper cites.
Online Replanning in Belief Space for Partially Observable Task and Motion Problems. In IEEE International Conference on Robotics and Automation
Caelan Reed Garrett, Chris Paxton, Tomás Lozano-Pérez, Leslie Pack Kaelbling, and Dieter Fox. 2020 · 2020
Earlier work this paper cites.
Evaluating Large Language Models Trained on Code. In arXiv:2107.03374
Mark Chen, Jerry Tworek, Heewoo Jun, Qiming Yuan, Henrique Ponde de Oliveira Pinto, Jared Kaplan, Harri Edwards, Yuri Burda, Nicholas Joseph, Greg Brockman, et al · 2021
Earlier work this paper cites.
Learning Transferable Visual Models From Natural Language Supervision. In International conference on machine learning
Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, Gretchen Krueger, and Ilya Sutskever. 2021 · 2021
Earlier work this paper cites.
VIMA: General Robot Manipulation with Multimodal Prompts. In NeurIPS Foundation Models for Decision Making Workshop
Yunfan Jiang, Agrim Gupta, Zichen Zhang, Guanzhi Wang, Yongqiang Dou, Yanjun Chen, Li Fei-Fei, Anima Anandkumar, Yuke Zhu, and Linxi Fan. 2022 · 2022
Earlier work this paper cites.
Junnan Li, Dongxu Li, Caiming Xiong, and Steven Hoi. 2022 · 2022
Earlier work this paper cites.
A Generalist Agent. In Transactions on Machine Learning Research
Scott Reed, Konrad Zolna, Emilio Parisotto, Sergio Gomez Colmenarejo, Alexander Novikov, Gabriel Barth-Maron, Mai Gimenez, Yury Sulsky, Jackie Kay, Jost Tobias Springenberg, et al · 2022
Earlier work this paper cites.
PDDL planning with pretrained large language models. In NeurIPS 2022 foundation models for decision making workshop
Tom Silver, Varun Hariprasad, Reece S Shuttleworth, Nishanth Kumar, Tomás Lozano-Pérez, and Leslie Pack Kaelbling. 2022 · 2022
Earlier work this paper cites.
Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, et al · 2023
Earlier work this paper cites.
PaLM-E: An Embodied Multimodal Language Model. In International Conference on Machine Learning
Danny Driess, Fei Xia, Mehdi SM Sajjadi, Corey Lynch, Aakanksha Chowdhery, Brian Ichter, Ayzaan Wahid, Jonathan Tompson, Quan Vuong, Tianhe Yu, et al · 2023
Earlier work this paper cites.
QGroundControl: Intuitive and Powerful Ground Control Station for the MAVLink protocol
DroneCode. 2023 · 2023
Earlier work this paper cites.
YOLO by Ultralytics
Glenn Jocher, Ayush Chaurasia, and Jing Qiu. 2023 · 2023
Cited alongside, same era.
An LLM compiler for parallel function calling. In International Conference on Machine Learning
Sehoon Kim, Suhong Moon, Ryan Tabrizi, Nicholas Lee, Michael W Mahoney, Kurt Keutzer, and Amir Gholami. 2023 · 2023
Cited alongside, same era.
Code as policies: Language model programs for embodied control. In IEEE International Conference on Robotics and Automation
Jacky Liang, Wenlong Huang, Fei Xia, Peng Xu, Karol Hausman, Brian Ichter, Pete Florence, and Andy Zeng. 2023 · 2023
Cited alongside, same era.
Text2Motion: From Natural Language Instructions to Feasible Plans. In Autonomous Robots
Kevin Lin, Christopher Agia, Toki Migimatsu, Marco Pavone, and Jeannette Bohg. 2023 · 2023
Cited alongside, same era.
Deja Vu: Contextual Sparsity for Efficient LLMs at Inference Time. In International Conference on Machine Learning
Zichang Liu, Jue Wang, Tri Dao, Tianyi Zhou, Binhang Yuan, Zhao Song, Anshumali Shrivastava, Ce Zhang, Yuandong Tian, Christopher Re, and Beidi Chen. 2023 · 2023
From Words to Flight: Integrating OpenAI ChatGPT with PX4/Gazebo for Natural Language-Based Drone Control. In International Workshop on Computer Science and Engineering
Mohamed Lamine TAZIR, Matei MANCAS, and Thierry DUTOIT. 2023 · 2023
Closest in time.
ChatGPT for Robotics: Design Principles and Model Abilities. In IEEE Access
Sai Vemprala, Rogerio Bonatti, Arthur Bucker, and Ashish Kapoor. 2023 · 2023
Closest in time.
Towards Understanding Chain-of-Thought Prompting: An Empirical Study of What Matters. In Annual Meeting of the Association for Computational Linguistics
Boshi Wang, Sewon Min, Xiang Deng, Jiaming Shen, You Wu, Luke Zettlemoyer, and Huan Sun. 2023 · 2023
Closest in time.
TidyBot: Personalized Robot Assistance with Large Language Models. In Autonomous Robots
Jimmy Wu, Rika Antonova, Adam Kan, Marion Lepert, Andy Zeng, Shuran Song, Jeannette Bohg, Szymon Rusinkiewicz, and Thomas Funkhouser. 2023 · 2023
Closest in time.
ReAct: Synergizing Reasoning and Acting in Language Models
Shunyu Yao, Jeffrey Zhao, Dian Yu, Nan Du, Izhak Shafran, Karthik Narasimhan, and Yuan Cao. 2023 · 2023
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
Large Language Models as General Pattern Machines. In Conference on Robot Learning
Suvir Mirchandani, Fei Xia, Pete Florence, Brian Ichter, Danny Driess, Montserrat Gonzalez Arenas, Kanishka Rao, Dorsa Sadigh, and Andy Zeng. 2023 · 2023
Cited alongside, same era.
tiktoken
OpenAI. 2023 · 2023
Cited alongside, same era.
Managing Delays in Human-Robot Interaction
Hannah Pelikan and Emily Hofstetter. 2023 · 2023
Cited alongside, same era.
Code Llama: Open Foundation Models for Code. In arXiv:2308.12950
Baptiste Roziere, Jonas Gehring, Fabian Gloeckle, Sten Sootla, Itai Gat, Xiaoqing Ellen Tan, Yossi Adi, Jingyu Liu, Tal Remez, Jérémy Rapin, et al · 2023
Cited alongside, same era.
Lm-nav: Robotic navigation with large pre-trained models of language, vision, and action. In Conference on robot learning
Dhruv Shah, Błażej Osiński, Sergey Levine, et al · 2023
Cited alongside, same era.
Progprompt: Generating situated robot task plans using large language models. In IEEE International Conference on Robotics and Automation
Ishika Singh, Valts Blukis, Arsalan Mousavian, Ankit Goyal, Danfei Xu, Jonathan Tremblay, Dieter Fox, Jesse Thomason, and Animesh Garg. 2023 · 2023
Cited alongside, same era.
LLM-Planner: Few-Shot Grounded Planning for Embodied Agents with Large Language Models. In IEEE/CVF International Conference on Computer Vision
Chan Hee Song, Jiaman Wu, Clayton Washington, Brian M. Sadler, Wei-Lun Chao, and Yu Su. 2023 · 2023
Cited alongside, same era.
Closest in time.
Chat with the Environment: Interactive Multimodal Perception Using Large Language Models. In IEEE/RSJ International Conference on Intelligent Robots and Systems
Xufeng Zhao, Mengdi Li, Cornelius Weber, Muhammad Burhan Hafez, and Stefan Wermter. 2023 · 2023
Closest in time.
RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control. In Conference on Robot Learning
Brianna Zitkovich, Tianhe Yu, Sichun Xu, Peng Xu, Ted Xiao, Fei Xia, Jialin Wu, Paul Wohlhart, Stefan Welker, Ayzaan Wahid, et al · 2023
Closest in time.
YOLO-World: Real-Time Open-Vocabulary Object Detection. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition
Tianheng Cheng, Lin Song, Yixiao Ge, Wenyu Liu, Xinggang Wang, and Ying Shan. 2024 · 2024
Closest in time.
Creating Edge AI from Cloud-based LLMs. In Proceedings of the 25th International Workshop on Mobile Computing Systems and Applications . Association for Computing Machinery
Qifei Dong, Xiangliang Chen, and Mahadev Satyanarayanan. 2024 · 2024
Closest in time.
Prompt Cache: Modular Attention Reuse for Low-Latency Inference. In Proceedings of Machine Learning and Systems
In Gim, Guojun Chen, Seung seob Lee, Nikhil Sarda, Anurag Khandelwal, and Lin Zhong. 2024 · 2024
Closest in time.
Generalized planning in pddl domains with pretrained large language models. In Proceedings of the AAAI Conference on Artificial Intelligence
Tom Silver, Soham Dan, Kavitha Srinivas, Joshua B Tenenbaum, Leslie Kaelbling, and Michael Katz. 2024 · 2024
Closest in time.
Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Models. In International Conference on Machine Learning
Andy Zhou, Kai Yan, Michal Shlapentokh-Rothman, Haohan Wang, and Yu-Xiong Wang. 2024 · 2024
Closest in time.