End-to-End Integration of Speech Recognition, Speech Enhancement, and Self-Supervised Learning Representation

Understand

This work presents our end-to-end (E2E) automatic speech recognition (ASR) model targetting at robust speech recognition, called Integraded speech Recognition with enhanced speech Input for Self-supervised learning representation (IRIS).

• Compared with conventional E2E ASR models, the proposed E2E model integrates two important modules including a speech enhancement (SE) module and a self-supervised learning representation (SSLR) module.
• The SE module enhances the noisy speech.
• Then the SSLR module extracts features from enhanced speech to be used for speech recognition (ASR).