You Only Need One Step: Fast Super-Resolution with Stable Diffusion via Scale Distillation

Understand

In this paper, we introduce YONOS-SR, a novel stable diffusion-based approach for image super-resolution that yields state-of-the-art results using only a single DDIM step.

• We propose a novel scale distillation approach to train our SR model.
• Instead of directly training our SR model on the scale factor of interest, we start by training a teacher model on a smaller magnification scale, thereby making the SR problem simpler for the teacher.
• We then train a student model for a higher magnification scale, using the predictions of the teacher as a target during the training.