Attend and Interact: Higher-Order Object Interactions for Video Understanding

Understand

Human actions often involve complex interactions across several inter-related objects in the scene.

• However, existing approaches to fine-grained video understanding or visual relationship detection often rely on single object representation or pairwise object relationships.
• Furthermore, learning interactions across multiple objects in hundreds of frames for video is computationally infeasible and performance may suffer since a large combinatorial space has to be modeled.
• In this paper, we propose to efficiently learn higher-order interactions between arbitrary subgroups of objects for fine-grained video understanding.