VFIMamba: Video Frame Interpolation with State Space Models

Understand

Inter-frame modeling is pivotal in generating intermediate frames for video frame interpolation (VFI).

• Current approaches predominantly rely on convolution or attention-based models, which often either lack sufficient receptive fields or entail significant computational overheads.
• Recently, Selective State Space Models (S6) have emerged, tailored specifically for long sequence modeling, offering both linear complexity and data-dependent modeling capabilities.
• In this paper, we propose VFIMamba, a novel frame interpolation method for efficient and dynamic inter-frame modeling by harnessing the S6 model.