AgentThink: A Unified Framework for Tool-Augmented Chain-of-Thought Reasoning in Vision-Language Models for Autonomous Driving

Textual explanations for self-driving vehicles

Jinkyu Kim, Anna Rohrbach, Trevor Darrell, John Canny, and Zeynep Akata · 2018

Earlier work this paper cites.

Hello, it’s gpt-2–how can i help you? towards the use of pretrained language models for task-oriented dialogue systems

Original

Paweł Budzianowski and Ivan Vulić · 2019

Earlier work this paper cites.

Be-sti: Spatial-temporal integrated network for class-agnostic motion prediction with bidirectional enhancement

Yunlong Wang, Hongyu Pan, Jun Zhu, Yu-Huan Wu, Xin Zhan, Kun Jiang, and Diange Yang · 2022

Earlier work this paper cites.

Gpt-driver: Learning to drive with gpt

Original

Jiageng Mao, Yuxi Qian, Junjie Ye, Hang Zhao, and Yue Wang · 2023

Earlier work this paper cites.

A language agent for autonomous driving

Original

Jiageng Mao, Junjie Ye, Yuxi Qian, Marco Pavone, and Yue Wang · 2023

Earlier work this paper cites.

Gpt-4 technical report

Original

OpenAI · 2023

Earlier work this paper cites.

Drivemlm: Aligning multi-modal large language models with behavioral planning states for autonomous driving

Original

Wenhai Wang, Jiangwei Xie, ChuanYang Hu, Haoming Zou, Jianan Fan, Wenwen Tong, Yang Wen, Silei Wu, Hanming Deng, Zhiqi Li, et al · 2023

Earlier work this paper cites.

Dilu: A knowledge-driven approach to autonomous driving with large language models

Original

Licheng Wen, Daocheng Fu, Xin Li, Xinyu Cai, Tao Ma, Pinlong Cai, Min Dou, Botian Shi, Liang He, and Yu Qiao · 2023

Earlier work this paper cites.

Driving with llms: Fusing object-level vector modality for explainable autonomous driving

Long Chen, Oleg Sinavski, Jan Hünermann, Alice Karnsund, Andrew James Willmott, Danny Birch, Daniel Maund, and Jamie Shotton · 2024

Earlier work this paper cites.

Expanding performance boundaries of open-source multimodal models with model, data, and test-time scaling

Original

Zhe Chen, Weiyun Wang, Yue Cao, Yangzhou Liu, Zhangwei Gao, Erfei Cui, Jinguo Zhu, Shenglong Ye, Hao Tian, Zhaoyang Liu, et al · 2024

Earlier work this paper cites.

Pluto: Pushing the limit of imitation learning-based planning for autonomous driving

Original

Jie Cheng, Yingbing Chen, and Qifeng Chen · 2024

Earlier work this paper cites.

A survey on multimodal large language models for autonomous driving

Can Cui, Yunsheng Ma, Xu Cao, Wenqian Ye, Yang Zhou, Kaizhao Liang, Jintai Chen, Juanwu Lu, Zichong Yang, Kuei-Da Liao, et al · 2024

Earlier work this paper cites.

Navsim: Data-driven non-reactive autonomous vehicle simulation and benchmarking

Daniel Dauner, Marcel Hallgarten, Tianyu Li, Xinshuo Weng, Zhiyu Huang, Zetong Yang, Hongyang Li, Igor Gilitschenski, Boris Ivanovic, Marco Pavone, et al · 2024

Earlier work this paper cites.

Holistic autonomous driving understanding by bird’s-eye-view injected multi-modal large models

Xinpeng Ding, Jianhua Han, Hang Xu, Xiaodan Liang, Wei Zhang, and Xiaomeng Li · 2024

Earlier work this paper cites.

Drive like a human: Rethinking autonomous driving with large language models

Daocheng Fu, Xin Li, Licheng Wen, Min Dou, Pinlong Cai, Botian Shi, and Yu Qiao · 2024

Earlier work this paper cites.

Drivemllm: A benchmark for spatial understanding with multimodal large language models in autonomous driving

Original

Xianda Guo, Ruijun Zhang, Yiqun Duan, Yuhang He, Chenming Zhang, Shuai Liu, and Long Chen · 2024

Earlier work this paper cites.

Vlm-rl: A unified vision language models and reinforcement learning framework for safe autonomous driving

Original

Zilin Huang, Zihao Sheng, Yansong Qu, Junwei You, and Sikai Chen · 2024

Earlier work this paper cites.

Emma: End-to-end multimodal model for autonomous driving. arxiv 2024

Original

JJ Hwang, R Xu, H Lin, WC Hung, J Ji, K Choi, D Huang, T He, P Covington, B Sapp, et al · 2024

Cited alongside, same era.

Emma: End-to-end multimodal model for autonomous driving

Original

Jyh-Jing Hwang, Runsheng Xu, Hubert Lin, Wei-Chih Hung, Jingwei Ji, Kristy Choi, Di Huang, Tong He, Paul Covington, Benjamin Sapp, et al · 2024

Cited alongside, same era.

Gpt-4o: The cutting-edge advancement in multimodal llm

Raisa Islam and Owana Marzia Moushi · 2024

Cited alongside, same era.

Llava-onevision: Easy visual task transfer

Original

Bo Li, Yuanhan Zhang, Dong Guo, Renrui Zhang, Feng Li, Hao Zhang, Kaichen Zhang, Peiyuan Zhang, Yanwei Li, Ziwei Liu, et al · 2024

Cited alongside, same era.

Ovis: Structural embedding alignment for multimodal large language model

Llava-o1: Let vision language models reason step-by-step

Original

Guowei Xu, Peng Jin, Li Hao, Yibing Song, Lichao Sun, and Li Yuan · 2024

Later among the works it cites.

Drivegpt4: Interpretable end-to-end autonomous driving via large language model

Zhenhua Xu, Yujia Zhang, Enze Xie, Zhen Zhao, Yong Guo, Kwan-Yee K Wong, Zhenguo Li, and Hengshuang Zhao · 2024

Later among the works it cites.

Mulberry: Empowering mllm with o1-like reasoning and reflection via collective monte carlo tree search

Original

Huanjin Yao, Jiaxing Huang, Wenhao Wu, Jingyi Zhang, Yibo Wang, Shunyu Liu, Yingjie Wang, Yuxin Song, Haocheng Feng, Li Shen, et al · 2024

Later among the works it cites.

Qwen2.5-vl technical report, 2025

Shuai Bai, Keqin Chen, Xuejing Liu, Jialin Wang, Wenbin Ge, Sibo Song, Kai Dang, Peng Wang, Shijie Wang, Jun Tang, Humen Zhong, Yuanzhi Zhu, Mingkun Yang, Zhaohai Li, Jianqiang Wan, Pengfei Wang, Wei Ding, Zheren Fu, Yiheng Xu, Jiabo Ye, Xi Zhang, Tianbao Xie, Zesen Cheng, Hang Zhang, Zhibo Yang, Haiyang Xu, and Junyang Lin · 2025

Closest in time.