MMSU: A Massive Multi-task Spoken Language Understanding and Reasoning Benchmark

Understand

Speech inherently contains rich acoustic information that extends far beyond the textual language.

• In real-world spoken language understanding, effective interpretation often requires integrating semantic meaning (e.g., content), paralinguistic features (e.g., emotions, speed, pitch) and phonological characteristics (e.g., prosody, intonation, rhythm), which are embedded in speech.
• While recent multimodal Speech Large Language Models (SpeechLLMs) have demonstrated remarkable capabilities in processing audio information, their ability to perform fine-grained perception and complex reasoning in natural speech remains largely unexplored.
• To address this gap, we introduce MMSU, a comprehensive benchmark designed specifically for understanding and reasoning in spoken language.