Audio-Language Datasets of Scenes and Events: A Survey

Understand

Audio-language models (ALMs) generate linguistic descriptions of sound-producing events and scenes.

• Advances in dataset creation and computational power have led to significant progress in this domain.
• This paper surveys 69 datasets used to train ALMs, covering research up to September 2024 (https://github.com/GLJS/audio-datasets).
• It provides a comprehensive analysis of datasets origins, audio and linguistic characteristics, and use cases.