SAM 3D: 3Dfy Anything in Images

Understand

We present SAM 3D, a generative model for visually grounded 3D object reconstruction, predicting geometry, texture, and layout from a single image.

• SAM 3D excels in natural images, where occlusion and scene clutter are common and visual recognition cues from context play a larger role.
• We achieve this with a human- and model-in-the-loop pipeline for annotating object shape, texture, and pose, providing visually grounded 3D reconstruction data at unprecedented scale.
• We learn from this data in a modern, multi-stage training framework that combines synthetic pretraining with real-world alignment, breaking the 3D "data barrier".