Game-Time: Evaluating Temporal Dynamics in Spoken Language Models

Understand

Conversational Spoken Language Models (SLMs) are emerging as a promising paradigm for real-time speech interaction.

• However, their capacity of temporal dynamics, including the ability to manage timing, tempo and simultaneous speaking, remains a critical and unevaluated challenge for conversational fluency.
• To address this gap, we introduce the Game-Time Benchmark, a framework to systematically assess these temporal capabilities.
• Inspired by how humans learn a language through language activities, Game-Time consists of basic instruction-following tasks and advanced tasks with temporal constraints, such as tempo adherence and synchronized responses.