Real Acoustic Fields: An Audio-Visual Room Acoustics Dataset and Benchmark

Understand

We present a new dataset called Real Acoustic Fields (RAF) that captures real acoustic room data from multiple modalities.

• The dataset includes high-quality and densely captured room impulse response data paired with multi-view images, and precise 6DoF pose tracking data for sound emitters and listeners in the rooms.
• We used this dataset to evaluate existing methods for novel-view acoustic synthesis and impulse response generation which previously relied on synthetic data.
• In our evaluation, we thoroughly assessed existing audio and audio-visual models against multiple criteria and proposed settings to enhance their performance on real-world data.