Zero-Shot Text-Guided Object Generation with Dream Fields

Understand

We combine neural rendering with multi-modal image and text representations to synthesize diverse 3D objects solely from natural language descriptions.

• Our method, Dream Fields, can generate the geometry and color of a wide range of objects without 3D supervision.
• Due to the scarcity of diverse, captioned 3D data, prior methods only generate objects from a handful of categories, such as ShapeNet.
• Instead, we guide generation with image-text models pre-trained on large datasets of captioned images from the web.