SEINE: Short-to-Long Video Diffusion Model for Generative Transition and Prediction

Understand

Recently video generation has achieved substantial progress with realistic results.

• Nevertheless, existing AI-generated videos are usually very short clips ("shot-level") depicting a single scene.
• To deliver a coherent long video ("story-level"), it is desirable to have creative transition and prediction effects across different clips.
• This paper presents a short-to-long video diffusion model, SEINE, that focuses on generative transition and prediction.