Efficient Sequence Training of Attention Models using Approximative Recombination

“Lattice-based optimization of sequence classification criteria for neural-network acoustic modeling,”

Brian Kingsbury, · 2009

Earlier work this paper cites.

“On Using Monolingual Corpora in Neural Machine Translation,”

Çaglar Gülçehre, Orhan Firat, Kelvin Xu, Kyunghyun Cho, Loïc Barrault, Huei-Chi Lin, Fethi Bougares, Holger Schwenk, and Yoshua Bengio, · 2017

Earlier work this paper cites.

“RETURNN: the RWTH extensible training framework for universal recurrent neural networks,”

Patrick Doetsch, Albert Zeyer, Paul Voigtlaender, Ilia Kulikov, Ralf Schlüter, and Hermann Ney, · 2017

Earlier work this paper cites.

“Minimum Word Error Rate Training for Attention-Based Sequence-to-Sequence Models,”

Rohit Prabhavalkar, Tara N. Sainath, Yonghui Wu, Patrick Nguyen, Zhifeng Chen, Chung-Cheng Chiu, and Anjuli Kannan, · 2018

Earlier work this paper cites.

“Sisyphus, a workflow manager designed for machine translation and automatic speech recognition,”

Jan-Thorsten Peter, Eugen Beck, and Hermann Ney, · 2018

Earlier work this paper cites.

“Lattice Generation in Attention-Based Speech Recognition Models,”

Michal Zapotoczny, Piotr Pietrzak, Adrian Lancucki, and Jan Chorowski, · 2019

Cited alongside, same era.

“SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognition,”

Daniel S. Park, William Chan, Yu Zhang, Chung-Cheng Chiu, Barret Zoph, Ekin D. Cubuk, and Quoc V. Le, · 2019

Cited alongside, same era.

“A Comparison of Transformer and LSTM Encoder Decoder Models for ASR,”

Albert Zeyer, Parnia Bahar, Kazuki Irie, R. Schlüter, and H. Ney, · 2019

Cited alongside, same era.

“wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations,”

Alexei Baevski, Yuhao Zhou, Abdelrahman Mohamed, and Michael Auli, · 2020

Cited alongside, same era.

“Early Stage LM Integration Using Local and Global Log-Linear Combination,”

Wilfried Michel, Ralf Schlüter, and Hermann Ney, · 2020

Later among the works it cites.

“Minimum Bayes Risk Training of RNN-Transducer for End-to-End Speech Recognition,”

Chao Weng, Chengzhu Yu, Jia Cui, Chunlei Zhang, and Dong Yu, · 2020

Later among the works it cites.

“On Minimum Word Error Rate Training of the Hybrid Autoregressive Transducer,”

Liang Lu, Zhong Meng, Naoyuki Kanda, Jinyu Li, and Yifan Gong, · 2021

Closest in time.

“Investigating Methods to Improve Language Model Integration for Attention-based Encoder-Decoder ASR Models,”

Mohammad Zeineldeen, Aleksandr Glushko, Wilfried Michel, Albert Zeyer, Ralf Schlüter, and Hermann Ney, · 2021

Closest in time.