Oscillation Inversion: Understand the structure of Large Flow Model through the Lens of Inversion Method

Understand

We explore the oscillatory behavior observed in inversion methods applied to large-scale text-to-image diffusion models, with a focus on the "Flux" model.

• By employing a fixed-point-inspired iterative approach to invert real-world images, we observe that the solution does not achieve convergence, instead oscillating between distinct clusters.
• Through both toy experiments and real-world diffusion models, we demonstrate that these oscillating clusters exhibit notable semantic coherence.
• We offer theoretical insights, showing that this behavior arises from oscillatory dynamics in rectified flow models.