Audio-Visual Segmentation by Exploring Cross-Modal Mutual Semantics

Understand

The audio-visual segmentation (AVS) task aims to segment sounding objects from a given video.

• Existing works mainly focus on fusing audio and visual features of a given video to achieve sounding object masks.
• However, we observed that prior arts are prone to segment a certain salient object in a video regardless of the audio information.
• This is because sounding objects are often the most salient ones in the AVS dataset.