DiffFashion: Reference-based Fashion Design with Structure-aware Transfer by Diffusion Models

Understand

Image-based fashion design with AI techniques has attracted increasing attention in recent years.

• We focus on a new fashion design task, where we aim to transfer a reference appearance image onto a clothing image while preserving the structure of the clothing image.
• It is a challenging task since there are no reference images available for the newly designed output fashion images.
• Although diffusion-based image translation or neural style transfer (NST) has enabled flexible style transfer, it is often difficult to maintain the original structure of the image realistically during the reverse diffusion, especially when the referenced appearance image greatly differs from the common clothing appearance.