Understanding Deformable Alignment in Video Super-Resolution

Understand

Deformable convolution, originally proposed for the adaptation to geometric variations of objects, has recently shown compelling performance in aligning multiple frames and is increasingly adopted for video super-resolution.

• Despite its remarkable performance, its underlying mechanism for alignment remains unclear.
• In this study, we carefully investigate the relation between deformable alignment and the classic flow-based alignment.
• We show that deformable convolution can be decomposed into a combination of spatial warping and convolution.