Structured Generative Models for Scene Understanding

Understand

This position paper argues for the use of \emph{structured generative models} (SGMs) for the understanding of static scenes.

• This requires the reconstruction of a 3D scene from an input image (or a set of multi-view images), whereby the contents of the image(s) are causally explained in terms of models of instantiated objects, each with their own type, shape, appearance and pose, along with global variables like scene lighting and camera parameters.
• This approach also requires scene models which account for the co-occurrences and inter-relationships of objects in a scene.
• The SGM approach has the merits that it is compositional and generative, which lead to interpretability and editability.