Efficient4D: Fast Dynamic 3D Object Generation from a Single-view Video

Understand

Generating dynamic 3D object from a single-view video is challenging due to the lack of 4D labeled data.

• An intuitive approach is to extend previous image-to-3D pipelines by transferring off-the-shelf image generation models such as score distillation sampling.However, this approach would be slow and expensive to scale due to the need for back-propagating the information-limited supervision signals through a large pretrained model.
• To address this, we propose an efficient video-to-4D object generation framework called Efficient4D.
• It generates high-quality spacetime-consistent images under different camera views, and then uses them as labeled data to directly reconstruct the 4D content through a 4D Gaussian splatting model.