Early Stage LM Integration Using Local and Global Log-Linear Combination

Understand

Sequence-to-sequence models with an implicit alignment mechanism (e.g.

• attention) are closing the performance gap towards traditional hybrid hidden Markov models (HMM) for the task of automatic speech recognition.
• One important factor to improve word error rate in both cases is the use of an external language model (LM) trained on large text-only corpora.
• Language model integration is straightforward with the clear separation of acoustic model and language model in classical HMM-based modeling.