Scene Graph Generation via Conditional Random Fields

Understand

Despite the great success object detection and segmentation models have achieved in recognizing individual objects in images, performance on cognitive tasks such as image caption, semantic image retrieval, and visual QA is far from satisfactory.

• To achieve better performance on these cognitive tasks, merely recognizing individual object instances is insufficient.
• Instead, the interactions between object instances need to be captured in order to facilitate reasoning and understanding of the visual scenes in an image.
• Scene graph, a graph representation of images that captures object instances and their relationships, offers a comprehensive understanding of an image.