Retinex-Diffusion: On Controlling Illumination Conditions in Diffusion Models via Retinex Theory

Understand

This paper introduces a novel approach to illumination manipulation in diffusion models, addressing the gap in conditional image generation with a focus on lighting conditions.

• We conceptualize the diffusion model as a black-box image render and strategically decompose its energy function in alignment with the image formation model.
• Our method effectively separates and controls illumination-related properties during the generative process.
• It generates images with realistic illumination effects, including cast shadow, soft shadow, and inter-reflections.