Unpaired Image Captioning by Image-level Weakly-Supervised Visual Concept Recognition

Understand

The goal of unpaired image captioning (UIC) is to describe images without using image-caption pairs in the training phase.

• Although challenging, we except the task can be accomplished by leveraging a training set of images aligned with visual concepts.
• Most existing studies use off-the-shelf algorithms to obtain the visual concepts because the Bounding Box (BBox) labels or relationship-triplet labels used for the training are expensive to acquire.
• In order to resolve the problem in expensive annotations, we propose a novel approach to achieve cost-effective UIC.