DASB - Discrete Audio and Speech Benchmark

Understand

Discrete audio tokens have recently gained considerable attention for their potential to bridge audio and language processing, enabling multimodal language models that can both generate and understand audio.

• However, preserving key information such as phonetic content, speaker identity, and paralinguistic cues remains a major challenge.
• Identifying the optimal tokenizer and configuration is further complicated by inconsistent evaluation settings across existing studies.
• To address this, we introduce the Discrete Audio and Speech Benchmark (DASB), a comprehensive framework for benchmarking discrete audio tokens across speech, general audio, and music domains on a range of discriminative and generative tasks.