Residual Language Model for End-to-end Speech Recognition

Understand

End-to-end automatic speech recognition suffers from adaptation to unknown target domain speech despite being trained with a large amount of paired audio--text data.

• Recent studies estimate a linguistic bias of the model as the internal language model (LM).
• To effectively adapt to the target domain, the internal LM is subtracted from the posterior during inference and fused with an external target-domain LM.
• However, this fusion complicates the inference and the estimation of the internal LM may not always be accurate.