3D Object Manipulation in a Single Image using Generative Models

Understand

Object manipulation in images aims to not only edit the object's presentation but also gift objects with motion.

• Previous methods encountered challenges in concurrently handling static editing and dynamic generation, while also struggling to achieve fidelity in object appearance and scene lighting.
• In this work, we introduce \textbf{OMG3D}, a novel framework that integrates the precise geometric control with the generative power of diffusion models, thus achieving significant enhancements in visual performance.
• Our framework first converts 2D objects into 3D, enabling user-directed modifications and lifelike motions at the geometric level.