Cinemo: Consistent and Controllable Image Animation with Motion Diffusion Models

Understand

Diffusion models have achieved great progress in image animation due to powerful generative capabilities.

• However, maintaining spatio-temporal consistency with detailed information from the input static image over time (e.g., style, background, and object of the input static image) and ensuring smoothness in animated video narratives guided by textual prompts still remains challenging.
• In this paper, we introduce Cinemo, a novel image animation approach towards achieving better motion controllability, as well as stronger temporal consistency and smoothness.
• In general, we propose three effective strategies at the training and inference stages of Cinemo to accomplish our goal.