Subword Encoding in Lattice LSTM for Chinese Word Segmentation

Understand

We investigate a lattice LSTM network for Chinese word segmentation (CWS) to utilize words or subwords.

• It integrates the character sequence features with all subsequences information matched from a lexicon.
• The matched subsequences serve as information shortcut tunnels which link their start and end characters directly.
• Gated units are used to control the contribution of multiple input links.