You Only Watch Once: A Unified CNN Architecture for Real-Time Spatiotemporal Action Localization

Understand

Spatiotemporal action localization requires the incorporation of two sources of information into the designed architecture: (1) temporal information from the previous frames and (2) spatial information from the key frame.

• Current state-of-the-art approaches usually extract these information with separate networks and use an extra mechanism for fusion to get detections.
• In this work, we present YOWO, a unified CNN architecture for real-time spatiotemporal action localization in video streams.
• YOWO is a single-stage architecture with two branches to extract temporal and spatial information concurrently and predict bounding boxes and action probabilities directly from video clips in one evaluation.