Adversarial reconstruction for Multi-modal Machine Translation

Understand

Even with the growing interest in problems at the intersection of Computer Vision and Natural Language, grounding (i.e.

• identifying) the components of a structured description in an image still remains a challenging task.
• This contribution aims to propose a model which learns grounding by reconstructing the visual features for the Multi-modal translation task.
• Previous works have partially investigated standard approaches such as regression methods to approximate the reconstruction of a visual input.