What Affects the Stability of Tool Learning? An Empirical Study on the Robustness of Tool Learning Frameworks

The probable error of a mean

Student. 1908 · 1908

Earlier work this paper cites.

Robustness of learning from task instructions

Original

Jiasheng Gu, Hongyu Zhao, Hanzi Xu, Liangyu Nie, Hongyuan Mei, and Wenpeng Yin. 2022 · 2022

Earlier work this paper cites.

Probing the creativity of large language models: Can models produce divergent semantic association?

Honghua Chen and Nai Ding. 2023 · 2023

Earlier work this paper cites.

Toolkengpt: Augmenting frozen language models with massive tools via tool embeddings

Shibo Hao, Tianyang Liu, Zhen Wang, and Zhiting Hu. 2023 · 2023

Earlier work this paper cites.

Tool documentation enables zero-shot tool-usage with large language models

Original

Cheng-Yu Hsieh, Si-An Chen, Chun-Liang Li, Yasuhisa Fujii, Alexander Ratner, Chen-Yu Lee, Ranjay Krishna, and Tomas Pfister. 2023 · 2023

Earlier work this paper cites.

Metatool benchmark for large language models: Deciding whether to use tools and which to use

Yue Huang, Jiawen Shi, Yuan Li, Chenrui Fan, Siyuan Wu, Qihui Zhang, Yixin Liu, Pan Zhou, Yao Wan, Neil Zhenqiang Gong, et al. 2023 · 2023

Earlier work this paper cites.

Mistral 7b

Original

Albert Qiaochu Jiang, Alexandre Sablayrolles, Arthur Mensch, Chris Bamford, Devendra Singh Chaplot, Diego de Las Casas, Florian Bressand, Gianna Lengyel, Guillaume Lample, Lucile Saulnier, L’elio Renard Lavaud, Marie-Anne Lachaux, Pierre Stock, Teven Le Scao, Thibaut Lavril, Thomas Wang, Timothée Lacroix, and William El Sayed. 2023 · 2023

Earlier work this paper cites.

Agentbench: Evaluating llms as agents

Original

Xiao Liu, Hao Yu, Hanchen Zhang, Yifan Xu, Xuanyu Lei, Hanyu Lai, Yu Gu, Hangliang Ding, Kaiwen Men, Kejuan Yang, et al. 2023 · 2023

Earlier work this paper cites.

Chameleon: Plug-and-play compositional reasoning with large language models

Pan Lu, Baolin Peng, Hao Cheng, Michel Galley, Kai-Wei Chang, Ying Nian Wu, Song-Chun Zhu, and Jianfeng Gao. 2023 · 2023

Earlier work this paper cites.

Gorilla: Large language model connected with massive apis

Shishir G Patil, Tianjun Zhang, Xin Wang, and Joseph E Gonzalez. 2023 · 2023

Earlier work this paper cites.

Investigating the factual knowledge boundary of large language models with retrieval augmentation

Original

Ruiyang Ren, Yuhao Wang, Yingqi Qu, Wayne Xin Zhao, Jing Liu, Hao Tian, Hua Wu, Ji-Rong Wen, and Haifeng Wang. 2023 · 2023

Cited alongside, same era.

Toolformer: Language Models Can Teach Themselves to Use Tools

Timo Schick, Jane Dwivedi-Yu, Roberto Dessì, Roberta Raileanu, Maria Lomeli, Luke Zettlemoyer, Nicola Cancedda, and Thomas Scialom. 2023 · 2023

Cited alongside, same era.

Towards a unified framework for reference retrieval and related work generation

Zhengliang Shi, Shen Gao, Zhen Zhang, Xiuying Chen, Zhumin Chen, Pengjie Ren, and Zhaochun Ren. 2023 · 2023

Cited alongside, same era.

RestGPT: Connecting Large Language Models with Real-World Applications via RESTful APIs

Yifan Song, Weimin Xiong, Dawei Zhu, Chengzu Li, Ke Wang, Ye Tian, and Sujian Li. 2023 · 2023

Cited alongside, same era.

On the tool manipulation capability of open-source large language models

Original

Zero-shot position debiasing for large language models

Original

Zhongkun Liu, Zheng Chen, Mengqi Zhang, Zhaochun Ren, Zhumin Chen, and Pengjie Ren. 2024 · 2024

Closest in time.

Is temperature the creativity parameter of large language models?

Original

Max Peeperkorn, Tom Kouwenhoven, Dan Brown, and Anna Jordanous. 2024 · 2024

Closest in time.

AUTOACT: Automatic Agent Learning from Scratch via Self-Planning

Original

Shuofei Qiao, Ningyu Zhang, Runnan Fang, Yujie Luo, Wangchunshu Zhou, Yuchen Eleanor Jiang, Chengfei Lv, and Huajun Chen. 2024 · 2024

Closest in time.

Identifying the risks of lm agents with an lm-emulated sandbox

Yangjun Ruan, Honghua Dong, Andrew Wang, Silviu Pitis, Yongchao Zhou, Jimmy Ba, Yann Dubois, Chris J. Maddison, and Tatsunori Hashimoto. 2024 · 2024

Closest in time.

Opportunities and challenges for chatgpt and large language models in biomedicine and health