Adaptable Multi-Domain Language Model for Transformer ASR

Understand

We propose an adapter based multi-domain Transformer based language model (LM) for Transformer ASR.

• The model consists of a big size common LM and small size adapters.
• The model can perform multi-domain adaptation with only the small size adapters and its related layers.
• The proposed model can reuse the full fine-tuned LM which is fine-tuned using all layers of an original model.