Integrating Scene Text and Visual Appearance for Fine-Grained Image Classification

Understand

Text in natural images contains rich semantics that are often highly relevant to objects or scene.

• In this paper, we focus on the problem of fully exploiting scene text for visual understanding.
• The main idea is combining word representations and deep visual features into a globally trainable deep convolutional neural network.
• First, the recognized words are obtained by a scene text reading system.