FloVD: Optical Flow Meets Video Diffusion Model for Enhanced Camera-Controlled Video Synthesis

Understand

We present FloVD, a novel video diffusion model for camera-controllable video generation.

• FloVD leverages optical flow to represent the motions of the camera and moving objects.
• This approach offers two key benefits.
• Since optical flow can be directly estimated from videos, our approach allows for the use of arbitrary training videos without ground-truth camera parameters.