Magic Fixup: Streamlining Photo Editing by Watching Dynamic Videos

Understand

We propose a generative model that, given a coarsely edited image, synthesizes a photorealistic output that follows the prescribed layout.

• Our method transfers fine details from the original image and preserve the identity of its parts.
• Yet, it adapts it to the lighting and context defined by the new layout.
• Our key insight is that videos are a powerful source of supervision for this task: objects and camera motions provide many observations of how the world changes with viewpoint, lighting, and physical interactions.