OBJECT 3DIT: Language-guided 3D-aware Image Editing

Understand

Existing image editing tools, while powerful, typically disregard the underlying 3D geometry from which the image is projected.

• As a result, edits made using these tools may become detached from the geometry and lighting conditions that are at the foundation of the image formation process.
• In this work, we formulate the newt ask of language-guided 3D-aware editing, where objects in an image should be edited according to a language instruction in context of the underlying 3D scene.
• To promote progress towards this goal, we release OBJECT: a dataset consisting of 400K editing examples created from procedurally generated 3D scenes.