IC3: Image Captioning by Committee Consensus

Understand

If you ask a human to describe an image, they might do so in a thousand different ways.

• Traditionally, image captioning models are trained to generate a single "best" (most like a reference) image caption.
• Unfortunately, doing so encourages captions that are "informationally impoverished," and focus on only a subset of the possible details, while ignoring other potentially useful information in the scene.
• In this work, we introduce a simple, yet novel, method: "Image Captioning by Committee Consensus" (IC3), designed to generate a single caption that captures high-level details from several annotator viewpoints.