MTU-Bench: A Multi-granularity Tool-Use Benchmark for Large Language Models

Understand

Large Language Models (LLMs) have displayed massive improvements in reasoning and decision-making skills and can hold natural conversations with users.

• Recently, many tool-use benchmark datasets have been proposed.
• However, existing datasets have the following limitations: (1).
• Insufficient evaluation scenarios (e.g., only cover limited tool-use scenes).