Mixture of Diffusers for scene composition and high resolution image generation

Understand

Diffusion methods have been proven to be very effective to generate images while conditioning on a text prompt.

• However, and although the quality of the generated images is unprecedented, these methods seem to struggle when trying to generate specific image compositions.
• In this paper we present Mixture of Diffusers, an algorithm that builds over existing diffusion models to provide a more detailed control over composition.
• By harmonizing several diffusion processes acting on different regions of a canvas, it allows generating larger images, where the location of each object and style is controlled by a separate diffusion process.