How to Read Paintings: Semantic Art Understanding with Multi-Modal Retrieval

Understand

Automatic art analysis has been mostly focused on classifying artworks into different artistic styles.

• However, understanding an artistic representation involves more complex processes, such as identifying the elements in the scene or recognizing author influences.
• We present SemArt, a multi-modal dataset for semantic art understanding.
• SemArt is a collection of fine-art painting images in which each image is associated to a number of attributes and a textual artistic comment, such as those that appear in art catalogues or museum collections.