FRESCO: Spatial-Temporal Correspondence for Zero-Shot Video Translation

Understand

The remarkable efficacy of text-to-image diffusion models has motivated extensive exploration of their potential application in video domains.

• Zero-shot methods seek to extend image diffusion models to videos without necessitating model training.
• Recent methods mainly focus on incorporating inter-frame correspondence into attention mechanisms.
• However, the soft constraint imposed on determining where to attend to valid features can sometimes be insufficient, resulting in temporal inconsistency.