Zero-Shot Duet Singing Voices Separation with Diffusion Models

Understand

In recent studies, diffusion models have shown promise as priors for solving audio inverse problems.

• These models allow us to sample from the posterior distribution of a target signal given an observed signal by manipulating the diffusion process.
• However, when separating audio sources of the same type, such as duet singing voices, the prior learned by the diffusion process may not be sufficient to maintain the consistency of the source identity in the separated audio.
• For example, the singer may change from one to another occasionally.