STUPD: A Synthetic Dataset for Spatial and Temporal Relation Reasoning

Understand

Understanding relations between objects is crucial for understanding the semantics of a visual scene.

• It is also an essential step in order to bridge visual and language models.
• However, current state-of-the-art computer vision models still lack the ability to perform spatial reasoning well.
• Existing datasets mostly cover a relatively small number of spatial relations, all of which are static relations that do not intrinsically involve motion.