TDAN: Temporally Deformable Alignment Network for Video Super-Resolution

Understand

Video super-resolution (VSR) aims to restore a photo-realistic high-resolution (HR) video frame from both its corresponding low-resolution (LR) frame (reference frame) and multiple neighboring frames (supporting frames).

• Due to varying motion of cameras or objects, the reference frame and each support frame are not aligned.
• Therefore, temporal alignment is a challenging yet important problem for VSR.
• Previous VSR methods usually utilize optical flow between the reference frame and each supporting frame to wrap the supporting frame for temporal alignment.