Built on

Internet-augmented dialogue generation
Original
Mojtaba Komeili, Kurt Shuster, and Jason Weston · 2021
Earlier work this paper cites.
Webgpt: Browser-assisted question-answering with human feedback
Original
Reiichiro Nakano, Jacob Hilton, Suchir Balaji, Jeff Wu, Long Ouyang, Christina Kim, Christopher Hesse, Shantanu Jain, Vineet Kosaraju, William Saunders, et al · 2021
Earlier work this paper cites.
A survey of deep learning for mathematical reasoning
Original
Pan Lu, Liang Qiu, Wenhao Yu, Sean Welleck, and Kai-Wei Chang · 2022
Earlier work this paper cites.
React: Synergizing reasoning and acting in language models
Original
Shunyu Yao, Jeffrey Zhao, Dian Yu, Nan Du, Izhak Shafran, Karthik Narasimhan, and Yuan Cao · 2022
Earlier work this paper cites.
Chain-of-thought prompting elicits reasoning in large language models
Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Fei Xia, Ed Chi, Quoc V Le, Denny Zhou, et al · 2022
Earlier work this paper cites.
Gpt-4 technical report
Original
Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, et al · 2023
Earlier work this paper cites.
Tool learning with foundation models
Original
Yujia Qin, Shengding Hu, Yankai Lin, Weize Chen, Ning Ding, Ganqu Cui, Zheni Zeng, Yufei Huang, Chaojun Xiao, Chi Han, et al · 2023
Earlier work this paper cites.
Making language models better tool learners with execution feedback
Original
Shuofei Qiao, Honghao Gui, Chengfei Lv, Qianghuai Jia, Huajun Chen, and Ningyu Zhang · 2023
Earlier work this paper cites.
Toolllm: Facilitating large language models to master 16000+ real-world apis
Original
Yujia Qin, Shihao Liang, Yining Ye, Kunlun Zhu, Lan Yan, Yaxi Lu, Yankai Lin, Xin Cong, Xiangru Tang, Bill Qian, et al · 2023
Earlier work this paper cites.
Api-bank: A benchmark for tool-augmented llms
Original
Minghao Li, Feifan Song, Bowen Yu, Haiyang Yu, Zhoujun Li, Fei Huang, and Yongbin Li · 2023
Earlier work this paper cites.
On the tool manipulation capability of open-source large language models
Original
Qiantong Xu, Fenglu Hong, Bo Li, Changran Hu, Zhengyu Chen, and Jian Zhang · 2023
Earlier work this paper cites.

Similar

Chatcot: Tool-augmented chain-of-thought reasoning on \ \backslash \ \backslash chat-based large language models
Original
Zhipeng Chen, Kun Zhou, Beichen Zhang, Zheng Gong, Wayne Xin Zhao, and Ji-Rong Wen · 2023
Cited alongside, same era.
Restgpt: Connecting large language models with real-world applications via restful apis
Original
Yifan Song, Weimin Xiong, Dawei Zhu, Cheng Li, Ke Wang, Ye Tian, and Sujian Li · 2023
Cited alongside, same era.
Creator: Tool creation for disentangling abstract and concrete reasoning of large language models
Cheng Qian, Chi Han, Yi Fung, Yujia Qin, Zhiyuan Liu, and Heng Ji · 2023
Cited alongside, same era.
Webcpm: Interactive web search for chinese long-form question answering
Original
Yujia Qin, Zihan Cai, Dian Jin, Lan Yan, Shihao Liang, Kunlun Zhu, Yankai Lin, Xu Han, Ning Ding, Huadong Wang, et al · 2023
Cited alongside, same era.

Then

Tool documentation enables zero-shot tool-usage with large language models
Original
Cheng-Yu Hsieh, Si-An Chen, Chun-Liang Li, Yasuhisa Fujii, Alexander Ratner, Chen-Yu Lee, Ranjay Krishna, and Tomas Pfister · 2023
Later among the works it cites.
Assistgpt: A general multi-modal assistant that can plan, execute, inspect, and learn
Original
Difei Gao, Lei Ji, Luowei Zhou, Kevin Qinghong Lin, Joya Chen, Zihan Fan, and Mike Zheng Shou · 2023
Later among the works it cites.
Large language models as tool makers
Original
Tianle Cai, Xuezhi Wang, Tengyu Ma, Xinyun Chen, and Denny Zhou · 2023
Later among the works it cites.
Gear: Augmenting language models with generalizable and efficient tool resolution
Original
Yining Lu, Haoping Yu, and Daniel Khashabi · 2023
Later among the works it cites.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Reading the bibliography…

2024

LLM With Tools: A Survey

Shen, Zhuocheng

Understand

The integration of tools in augmenting large language models presents a novel approach toward enhancing the efficiency and accuracy of these models in handling specific, complex tasks.

This paper delves into the methodology,challenges, and developments in the realm of teaching LLMs to use external tools, thereby pushing the boundaries of their capabilities beyond pre-existing knowledge bases.
We introduce a standardized paradigm for tool integration guided by a series of functions that map user instructions to actionable plans and their execution, emphasizing the significance of understanding user intent, tool selection, and dynamic plan adjustment.
Our exploration reveals the various challenges encountered, such as tool invocation timing, selection accuracy, and the need for robust reasoning processes.

Built on

Internet-augmented dialogue generation
Original
Mojtaba Komeili, Kurt Shuster, and Jason Weston · 2021
Earlier work this paper cites.
Webgpt: Browser-assisted question-answering with human feedback
Original
Reiichiro Nakano, Jacob Hilton, Suchir Balaji, Jeff Wu, Long Ouyang, Christina Kim, Christopher Hesse, Shantanu Jain, Vineet Kosaraju, William Saunders, et al · 2021
Earlier work this paper cites.
A survey of deep learning for mathematical reasoning
Original
Pan Lu, Liang Qiu, Wenhao Yu, Sean Welleck, and Kai-Wei Chang · 2022
Earlier work this paper cites.
React: Synergizing reasoning and acting in language models
Original
Shunyu Yao, Jeffrey Zhao, Dian Yu, Nan Du, Izhak Shafran, Karthik Narasimhan, and Yuan Cao · 2022
Earlier work this paper cites.
Chain-of-thought prompting elicits reasoning in large language models
Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Fei Xia, Ed Chi, Quoc V Le, Denny Zhou, et al · 2022
Earlier work this paper cites.
Gpt-4 technical report
Original
Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, et al · 2023
Earlier work this paper cites.
Tool learning with foundation models
Original
Yujia Qin, Shengding Hu, Yankai Lin, Weize Chen, Ning Ding, Ganqu Cui, Zheni Zeng, Yufei Huang, Chaojun Xiao, Chi Han, et al · 2023
Earlier work this paper cites.
Making language models better tool learners with execution feedback
Original
Shuofei Qiao, Honghao Gui, Chengfei Lv, Qianghuai Jia, Huajun Chen, and Ningyu Zhang · 2023
Earlier work this paper cites.
Toolllm: Facilitating large language models to master 16000+ real-world apis
Original
Yujia Qin, Shihao Liang, Yining Ye, Kunlun Zhu, Lan Yan, Yaxi Lu, Yankai Lin, Xin Cong, Xiangru Tang, Bill Qian, et al · 2023
Earlier work this paper cites.
Api-bank: A benchmark for tool-augmented llms
Original
Minghao Li, Feifan Song, Bowen Yu, Haiyang Yu, Zhoujun Li, Fei Huang, and Yongbin Li · 2023
Earlier work this paper cites.
On the tool manipulation capability of open-source large language models
Original
Qiantong Xu, Fenglu Hong, Bo Li, Changran Hu, Zhengyu Chen, and Jian Zhang · 2023
Earlier work this paper cites.

Similar

Chatcot: Tool-augmented chain-of-thought reasoning on \ \backslash \ \backslash chat-based large language models
Original
Zhipeng Chen, Kun Zhou, Beichen Zhang, Zheng Gong, Wayne Xin Zhao, and Ji-Rong Wen · 2023
Cited alongside, same era.
Restgpt: Connecting large language models with real-world applications via restful apis
Original
Yifan Song, Weimin Xiong, Dawei Zhu, Cheng Li, Ke Wang, Ye Tian, and Sujian Li · 2023
Cited alongside, same era.
Creator: Tool creation for disentangling abstract and concrete reasoning of large language models
Cheng Qian, Chi Han, Yi Fung, Yujia Qin, Zhiyuan Liu, and Heng Ji · 2023
Cited alongside, same era.
Webcpm: Interactive web search for chinese long-form question answering
Original
Yujia Qin, Zihan Cai, Dian Jin, Lan Yan, Shihao Liang, Kunlun Zhu, Yankai Lin, Xu Han, Ning Ding, Huadong Wang, et al · 2023
Cited alongside, same era.

Then

Tool documentation enables zero-shot tool-usage with large language models
Original
Cheng-Yu Hsieh, Si-An Chen, Chun-Liang Li, Yasuhisa Fujii, Alexander Ratner, Chen-Yu Lee, Ranjay Krishna, and Tomas Pfister · 2023
Later among the works it cites.
Assistgpt: A general multi-modal assistant that can plan, execute, inspect, and learn
Original
Difei Gao, Lei Ji, Luowei Zhou, Kevin Qinghong Lin, Joya Chen, Zihan Fan, and Mike Zheng Shou · 2023
Later among the works it cites.
Large language models as tool makers
Original
Tianle Cai, Xuezhi Wang, Tengyu Ma, Xinyun Chen, and Denny Zhou · 2023
Later among the works it cites.
Gear: Augmenting language models with generalizable and efficient tool resolution
Original
Yining Lu, Haoping Yu, and Daniel Khashabi · 2023
Later among the works it cites.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Toolcoder: Teach code generation models to use apis with search tools

Original

Kechi Zhang, Ge Li, Jia Li, Zhuo Li, and Zhi Jin · 2023

Cited alongside, same era.

Toolalpaca: Generalized tool learning for language models with 3000 simulated cases

Original

Qiaoyu Tang, Ziliang Deng, Hongyu Lin, Xianpei Han, Qiao Liang, and Le Sun · 2023

Cited alongside, same era.

Skills-in-context prompting: Unlocking compositionality in large language models

Original

Jiaao Chen, Xiaoman Pan, Dian Yu, Kaiqiang Song, Xiaoyang Wang, Dong Yu, and Jianshu Chen · 2023

Cited alongside, same era.

Taskbench: Benchmarking large language models for task automation

Original

Yongliang Shen, Kaitao Song, Xu Tan, Wenqi Zhang, Kan Ren, Siyu Yuan, Weiming Lu, Dongsheng Li, and Yueting Zhuang · 2023

Cited alongside, same era.

Multitool-cot: Gpt-3 can use multiple external tools with chain of thought prompting

Original

Tatsuro Inaba, Hirokazu Kiyomaru, Fei Cheng, and Sadao Kurohashi · 2023

Cited alongside, same era.

Taskmatrix. ai: Completing tasks by connecting foundation models with millions of apis

Original

Yaobo Liang, Chenfei Wu, Ting Song, Wenshan Wu, Yan Xia, Yu Liu, Yang Ou, Shuai Lu, Lei Ji, Shaoguang Mao, et al · 2023

Cited alongside, same era.

Gorilla: Large language model connected with massive apis

Original

Shishir G Patil, Tianjun Zhang, Xin Wang, and Joseph E Gonzalez · 2023

Cited alongside, same era.

Gpt4tools: Teaching large language model to use tools via self-instruction

Rui Yang, Lin Song, Yanwei Li, Sijie Zhao, Yixiao Ge, Xiu Li, and Ying Shan · 2024

Closest in time.

Toolqa: A dataset for llm question answering with external tools

Yuchen Zhuang, Yue Yu, Kuan Wang, Haotian Sun, and Chao Zhang · 2024

Closest in time.

Toolformer: Language models can teach themselves to use tools

Timo Schick, Jane Dwivedi-Yu, Roberto Dessì, Roberta Raileanu, Maria Lomeli, Eric Hambro, Luke Zettlemoyer, Nicola Cancedda, and Thomas Scialom · 2024

Closest in time.

Llms in the imaginarium: tool learning through simulated trial and error

Original

Boshi Wang, Hao Fang, Jason Eisner, Benjamin Van Durme, and Yu Su · 2024

Closest in time.

Toolkengpt: Augmenting frozen language models with massive tools via tool embeddings

Shibo Hao, Tianyang Liu, Zhen Wang, and Zhiting Hu · 2024

Closest in time.

Hugginggpt: Solving ai tasks with chatgpt and its friends in hugging face

Yongliang Shen, Kaitao Song, Xu Tan, Dongsheng Li, Weiming Lu, and Yueting Zhuang · 2024

Closest in time.

Chameleon: Plug-and-play compositional reasoning with large language models

Pan Lu, Baolin Peng, Hao Cheng, Michel Galley, Kai-Wei Chang, Ying Nian Wu, Song-Chun Zhu, and Jianfeng Gao · 2024

Closest in time.