LoGAN: Latent Graph Co-Attention Network for Weakly-Supervised Video Moment Retrieval

Understand

The goal of weakly-supervised video moment retrieval is to localize the video segment most relevant to the given natural language query without access to temporal annotations during training.

• Prior strongly- and weakly-supervised approaches often leverage co-attention mechanisms to learn visual-semantic representations for localization.
• However, while such approaches tend to focus on identifying relationships between elements of the video and language modalities, there is less emphasis on modeling relational context between video frames given the semantic context of the query.
• Consequently, the above-mentioned visual-semantic representations, built upon local frame features, do not contain much contextual information.