Background-aware Moment Detection for Video Moment Retrieval

Understand

Video moment retrieval (VMR) identifies a specific moment in an untrimmed video for a given natural language query.

• This task is prone to suffer the weak alignment problem innate in video datasets.
• Due to the ambiguity, a query does not fully cover the relevant details of the corresponding moment, or the moment may contain misaligned and irrelevant frames, potentially limiting further performance gains.
• To tackle this problem, we propose a background-aware moment detection transformer (BM-DETR).