HS-Diffusion: Semantic-Mixing Diffusion for Head Swapping

Understand

Image-based head swapping task aims to stitch a source head to another source body flawlessly.

• This seldom-studied task faces two major challenges: 1) Preserving the head and body from various sources while generating a seamless transition region.
• 2) No paired head swapping dataset and benchmark so far.
• In this paper, we propose a semantic-mixing diffusion model for head swapping (HS-Diffusion) which consists of a latent diffusion model (LDM) and a semantic layout generator.