Reducing Predictive Feature Suppression in Resource-Constrained Contrastive Image-Caption Retrieval

Understand

To train image-caption retrieval (ICR) methods, contrastive loss functions are a common choice for optimization functions.

• Unfortunately, contrastive ICR methods are vulnerable to predictive feature suppression.
• Predictive features are features that correctly indicate the similarity between a query and a candidate item.
• However, in the presence of multiple predictive features during training, encoder models tend to suppress redundant predictive features, since these features are not needed to learn to discriminate between positive and negative pairs.