An Exploration of Self-Supervised Pretrained Representations for End-to-End Speech Recognition

Understand

Self-supervised pretraining on speech data has achieved a lot of progress.

• High-fidelity representation of the speech signal is learned from a lot of untranscribed data and shows promising performance.
• Recently, there are several works focusing on evaluating the quality of self-supervised pretrained representations on various tasks without domain restriction, e.g.
• SUPERB.