MetaTool Benchmark for Large Language Models: Deciding Whether to Use Tools and Which to Use

Understand

Large language models (LLMs) have garnered significant attention due to their impressive natural language processing (NLP) capabilities.

• Recently, many studies have focused on the tool utilization ability of LLMs.
• They primarily investigated how LLMs effectively collaborate with given specific tools.
• However, in scenarios where LLMs serve as intelligent agents, as seen in applications like AutoGPT and MetaGPT, LLMs are expected to engage in intricate decision-making processes that involve deciding whether to employ a tool and selecting the most suitable tool(s) from a collection of available tools to fulfill user requests.