Negative Frames Matter in Egocentric Visual Query 2D Localization

Understand

The recently released Ego4D dataset and benchmark significantly scales and diversifies the first-person visual perception data.

• In Ego4D, the Visual Queries 2D Localization task aims to retrieve objects appeared in the past from the recording in the first-person view.
• This task requires a system to spatially and temporally localize the most recent appearance of a given object query, where query is registered by a single tight visual crop of the object in a different scene.
• Our study is based on the three-stage baseline introduced in the Episodic Memory benchmark.