Cache Me if You Can: Accelerating Diffusion Models through Block Caching

Understand

Diffusion models have recently revolutionized the field of image synthesis due to their ability to generate photorealistic images.

• However, one of the major drawbacks of diffusion models is that the image generation process is costly.
• A large image-to-image network has to be applied many times to iteratively refine an image from random noise.
• While many recent works propose techniques to reduce the number of required steps, they generally treat the underlying denoising network as a black box.