Latent Video Diffusion Models for High-Fidelity Long Video Generation

Understand

AI-generated content has attracted lots of attention recently, but photo-realistic video synthesis is still challenging.

• Although many attempts using GANs and autoregressive models have been made in this area, the visual quality and length of generated videos are far from satisfactory.
• Diffusion models have shown remarkable results recently but require significant computational resources.
• To address this, we introduce lightweight video diffusion models by leveraging a low-dimensional 3D latent space, significantly outperforming previous pixel-space video diffusion models under a limited computational budget.