SentiCap: Generating Image Descriptions with Sentiments

Understand

The recent progress on image recognition and language modeling is making automatic description of image content a reality.

• However, stylized, non-factual aspects of the written description are missing from the current systems.
• One such style is descriptions with emotions, which is commonplace in everyday communication, and influences decision-making and interpersonal relationships.
• We design a system to describe an image with emotions, and present a model that automatically generates captions with positive or negative sentiments.