Flow-Guided Diffusion for Video Inpainting

Understand

Video inpainting has been challenged by complex scenarios like large movements and low-light conditions.

• Current methods, including emerging diffusion models, face limitations in quality and efficiency.
• This paper introduces the Flow-Guided Diffusion model for Video Inpainting (FGDVI), a novel approach that significantly enhances temporal consistency and inpainting quality via reusing an off-the-shelf image generation diffusion model.
• We employ optical flow for precise one-step latent propagation and introduces a model-agnostic flow-guided latent interpolation technique.