Temporal Early Exits for Efficient Video Object Detection

Understand

Transferring image-based object detectors to the domain of video remains challenging under resource constraints.

• Previous efforts utilised optical flow to allow unchanged features to be propagated, however, the overhead is considerable when working with very slowly changing scenes from applications such as surveillance.
• In this paper, we propose temporal early exits to reduce the computational complexity of per-frame video object detection.
• Multiple temporal early exit modules with low computational overhead are inserted at early layers of the backbone network to identify the semantic differences between consecutive frames.