API Agents vs. GUI Agents: Divergence and Convergence

UI is communication: How to design intuitive, user centered interfaces by focusing on effective communication

Everett N McKay · 2013

Earlier work this paper cites.

Taskweaver: A code-first agent framework

Original

Bo Qiao, Liqun Li, Xu Zhang, Shilin He, Yu Kang, Chaoyun Zhang, Fangkai Yang, Hang Dong, Jue Zhang, Lu Wang, et al · 2023

Earlier work this paper cites.

A survey of large language models

Original

Wayne Xin Zhao, Kun Zhou, Junyi Li, Tianyi Tang, Xiaolei Wang, Yupeng Hou, Yingqian Min, Beichen Zhang, Junjie Zhang, Zican Dong, et al · 2023

Earlier work this paper cites.

Anytool: Self-reflective, hierarchical agents for large-scale api calls

Original

Yu Du, Fangyun Wei, and Hongyang Zhang · 2024

Earlier work this paper cites.

Cogagent: A visual language model for gui agents

Wenyi Hong, Weihan Wang, Qingsong Lv, Jiazheng Xu, Wenmeng Yu, Junhui Ji, Yan Wang, Zihan Wang, Yuxiao Dong, Ming Ding, et al · 2024

Earlier work this paper cites.

Gpt-4o system card

Original

Aaron Hurst, Adam Lerer, Adam P Goucher, Adam Perelman, Aditya Ramesh, Aidan Clark, AJ Ostrow, Akila Welihinda, Alan Hayes, Alec Radford, et al · 2024

Earlier work this paper cites.

Omniparser for pure vision based gui agent

Original

Yadong Lu, Jianwei Yang, Yelong Shen, and Ahmed Awadallah · 2024

Cited alongside, same era.

Llm with tools: A survey

Original

Zhuocheng Shen · 2024

Cited alongside, same era.

Beyond browsing: Api-based web agents

Yueqi Song, Frank F Xu, Shuyan Zhou, and Graham Neubig · 2024

Cited alongside, same era.

An introduction to microsoft copilot

Jess Stratton · 2024

Cited alongside, same era.

Automating the enterprise with foundation models

Michael Wornow, Avanika Narayan, Krista Opsahl-Ong, Quinn McIntyre, Nigam Shah, and Christopher Re · 2024

Cited alongside, same era.

A survey on large language model based autonomous agents

Lei Wang, Chen Ma, Xueyang Feng, Zeyu Zhang, Hao Yang, Jingsen Zhang, Zhiyuan Chen, Jiakai Tang, Xu Chen, Yankai Lin, et al

Osworld: Benchmarking multimodal agents for open-ended tasks in real computer environments

Tianbao Xie, Danyang Zhang, Jixuan Chen, Xiaochuan Li, Siheng Zhao, Ruisheng Cao, Jing Hua Toh, Zhoujun Cheng, Dongchan Shin, Fangyu Lei, et al · 2024

Later among the works it cites.

Carbon and silicon, coexist or compete? a survey on human-ai interactions in agent-based modeling and simulation

Original

Ziyue Lin, Siqi Shen, Zichen Cheng, Cheok Lam Lai, and Siming Chen · 2025

Closest in time.

Operator system card, January 2025

OpenAI · 2025

Closest in time.

Metachain: A fully-automated and zero-code framework for llm agents

Original

Jiabin Tang, Tianyu Fan, and Chao Huang · 2025

Closest in time.

Vem: Environment-free exploration for training gui agent with value environment model

Original

Jiani Zheng, Lu Wang, Fangkai Yang, Chaoyun Zhang, Lingrui Mei, Wenjie Yin, Qingwei Lin, Dongmei Zhang, Saravan Rajmohan, and Qi Zhang · 2025