Augmenting Librispeech with French Translations: A Multimodal Corpus for Direct Speech Translation Evaluation

Understand

Recent works in spoken language translation (SLT) have attempted to build end-to-end speech-to-text translation without using source language transcription during learning or decoding.

• However, while large quantities of parallel texts (such as Europarl, OpenSubtitles) are available for training machine translation systems, there are no large (100h) and open source parallel corpora that include speech in a source language aligned to text in a target language.
• This paper tries to fill this gap by augmenting an existing (monolingual) corpus: LibriSpeech.
• This corpus, used for automatic speech recognition, is derived from read audiobooks from the LibriVox project, and has been carefully segmented and aligned.