Discovering A Variety of Objects in Spatio-Temporal Human-Object Interactions

Understand

Spatio-temporal Human-Object Interaction (ST-HOI) detection aims at detecting HOIs from videos, which is crucial for activity understanding.

• In daily HOIs, humans often interact with a variety of objects, e.g., holding and touching dozens of household items in cleaning.
• However, existing whole body-object interaction video benchmarks usually provide limited object classes.
• Here, we introduce a new benchmark based on AVA: Discovering Interacted Objects (DIO) including 51 interactions and 1,000+ objects.