SoundSpaces 2.0: A Simulation Platform for Visual-Acoustic Learning

Understand

We introduce SoundSpaces 2.0, a platform for on-the-fly geometry-based audio rendering for 3D environments.

• Given a 3D mesh of a real-world environment, SoundSpaces can generate highly realistic acoustics for arbitrary sounds captured from arbitrary microphone locations.
• Together with existing 3D visual assets, it supports an array of audio-visual research tasks, such as audio-visual navigation, mapping, source localization and separation, and acoustic matching.
• Compared to existing resources, SoundSpaces 2.0 has the advantages of allowing continuous spatial sampling, generalization to novel environments, and configurable microphone and material properties.