PixelSynth: Generating a 3D-Consistent Experience from a Single Image

Understand

Recent advancements in differentiable rendering and 3D reasoning have driven exciting results in novel view synthesis from a single image.

• Despite realistic results, methods are limited to relatively small view change.
• In order to synthesize immersive scenes, models must also be able to extrapolate.
• We present an approach that fuses 3D reasoning with autoregressive modeling to outpaint large view changes in a 3D-consistent manner, enabling scene synthesis.