Rethinking Reprojection: Closing the Loop for Pose-aware ShapeReconstruction from a Single Image

Understand

An emerging problem in computer vision is the reconstruction of 3D shape and pose of an object from a single image.

• Hitherto, the problem has been addressed through the application of canonical deep learning methods to regress from the image directly to the 3D shape and pose labels.
• These approaches, however, are problematic from two perspectives.
• First, they are minimizing the error between 3D shapes and pose labels - with little thought about the nature of this label error when reprojecting the shape back onto the image.