DiffRF: Rendering-Guided 3D Radiance Field Diffusion

Understand

We introduce DiffRF, a novel approach for 3D radiance field synthesis based on denoising diffusion probabilistic models.

• While existing diffusion-based methods operate on images, latent codes, or point cloud data, we are the first to directly generate volumetric radiance fields.
• To this end, we propose a 3D denoising model which directly operates on an explicit voxel grid representation.
• However, as radiance fields generated from a set of posed images can be ambiguous and contain artifacts, obtaining ground truth radiance field samples is non-trivial.