UniVG: Towards UNIfied-modal Video Generation

Understand

Diffusion based video generation has received extensive attention and achieved considerable success within both the academic and industrial communities.

• However, current efforts are mainly concentrated on single-objective or single-task video generation, such as generation driven by text, by image, or by a combination of text and image.
• This cannot fully meet the needs of real-world application scenarios, as users are likely to input images and text conditions in a flexible manner, either individually or in combination.
• To address this, we propose a Unified-modal Video Genearation system that is capable of handling multiple video generation tasks across text and image modalities.