Multi-modal Feature Fusion with Feature Attention for VATEX Captioning Challenge 2020

Understand

This report describes our model for VATEX Captioning Challenge 2020.

• First, to gather information from multiple domains, we extract motion, appearance, semantic and audio features.
• Then we design a feature attention module to attend on different feature when decoding.
• We apply two types of decoders, top-down and X-LAN and ensemble these models to get the final result.