LLM-Coordination: Evaluating and Analyzing Multi-agent Coordination Abilities in Large Language Models

Understand

Large Language Models (LLMs) have demonstrated emergent common-sense reasoning and Theory of Mind (ToM) capabilities, making them promising candidates for developing coordination agents.

• This study introduces the LLM-Coordination Benchmark, a novel benchmark for analyzing LLMs in the context of Pure Coordination Settings, where agents must cooperate to maximize gains.
• Our benchmark evaluates LLMs through two distinct tasks.
• The first is Agentic Coordination, where LLMs act as proactive participants in four pure coordination games.