Automated test generation to evaluate tool-augmented LLMs as conversational AI agents

Agentbench: Evaluating llms as agents

Original

Xiao Liu, Hao Yu, Hanchen Zhang, Yifan Xu, Xuanyu Lei, Hanyu Lai, Yu Gu, Yuxian Gu, Hangliang Ding, Kai Men, Kejuan Yang, Shudan Zhang, Xiang Deng, Aohan Zeng, Zhengxiao Du, Chenhui Zhang, Shengqi Shen, Tianjun Zhang, Yu Su, Huan Sun, Minlie Huang, Yuxiao Dong, and Jie Tang. 2023 · 2023

Earlier work this paper cites.

Gaia: a benchmark for general ai assistants

Original

Grégoire Mialon, Clémentine Fourrier, Craig Swift, Thomas Wolf, Yann André LeCun, and Thomas Scialom. 2023 · 2023

Earlier work this paper cites.

Conditional generation with a question-answering blueprint

Shashi Narayan, Joshua Maynez, Reinald Kim Amplayo, Kuzman Ganchev, Annie Louis, Fantine Huot, Anders Sandholm, Dipanjan Das, and Mirella Lapata. 2023 · 2023

Earlier work this paper cites.

Gorilla: Large language model connected with massive apis

Original

Shishir G Patil, Tianjun Zhang, Xin Wang, and Joseph E Gonzalez. 2023 · 2023

Earlier work this paper cites.

Toolllm: Facilitating large language models to master 16000+ real-world apis

Original

Yujia Qin, Shihao Liang, Yining Ye, Kunlun Zhu, Lan Yan, Yaxi Lu, Yankai Lin, Xin Cong, Xiangru Tang, Bill Qian, et al. 2023 · 2023

Earlier work this paper cites.

Autogen: Enabling next-gen llm applications via multi-agent conversation framework

Original

Qingyun Wu, Gagan Bansal, Jieyu Zhang, Yiran Wu, Shaokun Zhang, Erkang Zhu, Beibin Li, Li Jiang, Xiaoyun Zhang, and Chi Wang. 2023 · 2023

Earlier work this paper cites.

Natural language is all a graph needs

Original

Ruosong Ye, Caiqi Zhang, Runhui Wang, Shuyuan Xu, Yongfeng Zhang, et al. 2023 · 2023

Cited alongside, same era.

Agenttuning: Enabling generalized agent abilities for llms

Original

Aohan Zeng, Mingdao Liu, Rui Lu, Bowen Wang, Xiao Liu, Yuxiao Dong, and Jie Tang. 2023 · 2023

Cited alongside, same era.

Api-blend: A comprehensive corpora for training and benchmarking api llms

Original

Kinjal Basu, Ibrahim Abdelaziz, Subhajit Chaudhury, Soham Dan, Maxwell Crouse, Asim Munawar, Sadhana Kumaravel, Vinod Muthusamy, Pavan Kapanipathi, and Luis A Lastras. 2024 · 2024

Cited alongside, same era.

A complete survey on llm-based ai chatbots

Original

Sumit Kumar Dam, Choong Seon Hong, Yu Qiao, and Chaoning Zhang. 2024 · 2024

Cited alongside, same era.

Teachers’ agency in the era of llm and generative ai

Yu-Ju Lan and Nian-Shing Chen. 2024 · 2024

Closest in time.

Personal llm agents: Insights and survey about the capability, efficiency and security

Original

Yuanchun Li, Hao Wen, Weijun Wang, Xiangyu Li, Yizhen Yuan, Guohong Liu, Jiacheng Liu, Wenxing Xu, Xiang Wang, Yi Sun, et al. 2024 · 2024

Closest in time.

Agentinstruct: Toward generative teaching with agentic flows

Arindam Mitra, Luciano Del Corro, Guoqing Zheng, Shweti Mahajan, Dany Rouhana, Andres Codas, Yadong Lu, Wei ge Chen, Olga Vrousgos, Corby Rosset, Fillipe Silva, Hamed Khanpour, Yash Lara, and Ahmed Awadallah. 2024 · 2024

Closest in time.

Can language models solve graph problems in natural language?

Heng Wang, Shangbin Feng, Tianxing He, Zhaoxuan Tan, Xiaochuang Han, and Yulia Tsvetkov. 2024 · 2024

Closest in time.

Toolqa: A dataset for llm question answering with external tools

Yuchen Zhuang, Yue Yu, Kuan Wang, Haotian Sun, and Chao Zhang. 2024 · 2024

Closest in time.