Multi-Agent Autonomous Driving Systems with Large Language Models: A Survey of Recent Advances

Language models are few-shot learners

Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al. 2020 · 1901

Earlier work this paper cites.

Are we ready for autonomous driving? the kitti vision benchmark suite

Andreas Geiger, Philip Lenz, et al. 2012 · 2012

Earlier work this paper cites.

Carla: An open urban driving simulator

Alexey Dosovitskiy, German Ros, Felipe Codevilla, Antonio Lopez, and Vladlen Koltun. 2017 · 2017

Earlier work this paper cites.

Dialogue learning with human-in-the-loop

Jiwei Li, Alexander H Miller, Sumit Chopra, Marc’Aurelio Ranzato, and Jason Weston. 2017 · 2017

Earlier work this paper cites.

Textual explanations for self-driving vehicles

Jinkyu Kim, Anna Rohrbach, Trevor Darrell, John Canny, and Zeynep Akata. 2018 · 2018

Earlier work this paper cites.

Conditional affordance learning for driving in urban environments

Axel Sauer, Nikolay Savinov, and Andreas Geiger. 2018 · 2018

Earlier work this paper cites.

nuscenes: A multimodal dataset for autonomous driving

Andreas Geiger, Philip Lenz, and Raquel Urtasun. 2020 · 2020

Earlier work this paper cites.

Scalability in perception for autonomous driving: Waymo open dataset

Pei Sun, Henrik Kretzschmar, Xerxes Dotiwalla, Aurelien Chouard, Vijaysai Patnaik, Paul Tsui, James Guo, Yin Zhou, Yuning Chai, Benjamin Caine, et al. 2020 · 2020

Earlier work this paper cites.

Bdd100k: A diverse driving dataset for heterogeneous multitask learning

Fisher Yu, Haofeng Chen, Xin Wang, Wenqi Xian, Yingying Chen, Fangchen Liu, Vashisht Madhavan, and Trevor Darrell. 2020 · 2020

Earlier work this paper cites.

A survey of autonomous driving: Common practices and emerging technologies

Ekim Yurtsever, Jacob Lambert, Alexander Carballo, and Kazuya Takeda. 2020 · 2020

Earlier work this paper cites.

Collaborative autonomous driving—a survey of solution approaches and future challenges

Senkang Hu, Zhengru Fang, Yiqin Deng, Xianhao Chen, and Yuguang Fang. 2021 · 2021

Earlier work this paper cites.

DETR3d: 3d object detection from multi-view images via 3d-to-2d queries

Yue Wang, Vitor Campagnolo Guizilini, Tianyuan Zhang, Yilun Wang, Hang Zhao, and Justin Solomon. 2021 · 2021

Earlier work this paper cites.

Emergence of hierarchical reference systems in multi-agent communication

Xenia Ohmer, Marko Duda, and Elia Bruni. 2022 · 2022

Earlier work this paper cites.

Motion transformer with global intention localization and local movement refinement

Shaoshuai Shi, Li Jiang, Dengxin Dai, and Bernt Schiele. 2022 · 2022

Earlier work this paper cites.

V2x-vit: Vehicle-to-everything cooperative perception with vision transformer

Runsheng Xu, Hao Xiang, Zhengzhong Tu, Xin Xia, Ming-Hsuan Yang, and Jiaqi Ma. 2022 · 2022

Earlier work this paper cites.

Dair-v2x: A large-scale dataset for vehicle-infrastructure cooperative 3d object detection

Haibao Yu, Yizhen Luo, Mao Shu, Yiyi Huo, Zebang Yang, Yifeng Shi, Zhenglong Guo, Hanyu Li, Xing Hu, Jirui Yuan, et al. 2022 · 2022

Earlier work this paper cites.

Gpt-4 technical report

Original

Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, et al. 2023 · 2023

Earlier work this paper cites.

Personalized autonomous driving with large language models: Field experiments

Original

C Cui, Z Yang, Y Zhou, Y Ma, J Lu, L Li, Y Chen, J Panchal, and Z Wang. 2023 · 2023

Earlier work this paper cites.

Llama-adapter v2: Parameter-efficient visual instruction model

Original

Peng Gao, Jiaming Han, Renrui Zhang, Ziyi Lin, Shijie Geng, Aojun Zhou, Wei Zhang, Pan Lu, Conghui He, Xiangyu Yue, et al. 2023 · 2023

Earlier work this paper cites.

Collaborative perception in autonomous driving: Methods, datasets, and challenges

Yushan Han, Hui Zhang, Huifang Li, Yi Jin, Congyan Lang, and Yidong Li. 2023 · 2023

Cited alongside, same era.

A survey on hallucination in large language models: Principles, taxonomy, challenges, and open questions

Original

Lei Huang, Weijiang Yu, Weitao Ma, Weihong Zhong, Zhangyin Feng, Haotian Wang, Qianglong Chen, Weihua Peng, Xiaocheng Feng, Bing Qin, et al. 2023 · 2023

Cited alongside, same era.

Towards knowledge-driven autonomous driving

Original

Xin Li, Yeqi Bai, Pinlong Cai, Licheng Wen, Daocheng Fu, Bo Zhang, Xuemeng Yang, Xinyu Cai, Tao Ma, Jianfei Guo, et al. 2023 · 2023

Cited alongside, same era.

Gpt-driver: Learning to drive with gpt

Original

Jiageng Mao, Yuxi Qian, Junjie Ye, Hang Zhao, and Yue Wang. 2023 · 2023

Cited alongside, same era.

Languagempc: Large language models as decision makers for autonomous driving

Surrealdriver: Designing llm-powered generative driver agent framework based on human drivers’ driving-thinking data

Ye Jin, Ruoxuan Yang, Zhijie Yi, Xiaoxi Shen, Huiling Peng, Xiaoan Liu, Jingli Qin, Jiayang Li, Jintao Xie, Peizhong Gao, et al. 2024 · 2024

Later among the works it cites.

A survey on llm-based multi-agent systems: workflow, infrastructure, and challenges

Xinyi Li, Sai Wang, Siqi Zeng, Yu Wu, and Yi Yang. 2024 · 2024

Later among the works it cites.

Encouraging divergent thinking in large language models through multi-agent debate

Tian Liang, Zhiwei He, Wenxiang Jiao, Xing Wang, Yan Wang, Rui Wang, Yujiu Yang, Shuming Shi, and Zhaopeng Tu. 2024 · 2024

Later among the works it cites.

Activead: Planning-oriented active learning for end-to-end autonomous driving

Original

Han Lu, Xiaosong Jia, Yichen Xie, Wenlong Liao, Xiaokang Yang, and Junchi Yan. 2024 · 2024

Later among the works it cites.

Learning autonomous driving tasks via human feedbacks with large language models

Yunsheng Ma, Xu Cao, Wenqian Ye, Can Cui, Kai Mei, and Ziran Wang. 2024 · 2024