Reconstructive Sequence-Graph Network for Video Summarization

Understand

Exploiting the inner-shot and inter-shot dependencies is essential for key-shot based video summarization.

• Current approaches mainly devote to modeling the video as a frame sequence by recurrent neural networks.
• However, one potential limitation of the sequence models is that they focus on capturing local neighborhood dependencies while the high-order dependencies in long distance are not fully exploited.
• In general, the frames in each shot record a certain activity and vary smoothly over time, but the multi-hop relationships occur frequently among shots.