VideoLightFormer: Lightweight Action Recognition using Transformers

Understand

Efficient video action recognition remains a challenging problem.

• One large model after another takes the place of the state-of-the-art on the Kinetics dataset, but real-world efficiency evaluations are often lacking.
• In this work, we fill this gap and investigate the use of transformers for efficient action recognition.
• We propose a novel, lightweight action recognition architecture, VideoLightFormer.