Character Matters: Video Story Understanding with Character-Aware Relations

Understand

Different from short videos and GIFs, video stories contain clear plots and lists of principal characters.

• Without identifying the connection between appearing people and character names, a model is not able to obtain a genuine understanding of the plots.
• Video Story Question Answering (VSQA) offers an effective way to benchmark higher-level comprehension abilities of a model.
• However, current VSQA methods merely extract generic visual features from a scene.