FashionBERT: Text and Image Matching with Adaptive Loss for Cross-modal Retrieval

Understand

In this paper, we address the text and image matching in cross-modal retrieval of the fashion industry.

• Different from the matching in the general domain, the fashion matching is required to pay much more attention to the fine-grained information in the fashion images and texts.
• Pioneer approaches detect the region of interests (i.e., RoIs) from images and use the RoI embeddings as image representations.
• In general, RoIs tend to represent the "object-level" information in the fashion images, while fashion texts are prone to describe more detailed information, e.g.