Explaining Character-Aware Neural Networks for Word-Level Prediction: Do They Discover Linguistic Rules?

Understand

Character-level features are currently used in different neural network-based natural language processing algorithms.

• However, little is known about the character-level patterns those models learn.
• Moreover, models are often compared only quantitatively while a qualitative analysis is missing.
• In this paper, we investigate which character-level patterns neural networks learn and if those patterns coincide with manually-defined word segmentations and annotations.