Fetching the paper…
Reading the bibliography…
Recently Deep Transformer models have proven to be particularly powerful in language modeling tasks for ASR.
“An empirical study of smoothing techniques for language modeling,”
Stanley F. Chen and Joshua Goodman, · 1999
Earlier work this paper cites.
“Unsupervised discovery of morphemes,”
Mathias Creutz and Krista Lagus, · 2002
Earlier work this paper cites.
“SRILM – an extensible language modeling toolkit,”
A. Stolcke, · 2002
Earlier work this paper cites.
“An introduction to ROC analysis,”
Tom Fawcett, · 2006
Earlier work this paper cites.
“Unlimited vocabulary speech recognition for agglutinative languages,”
Mikko Kurimo, Antti Puurula, Ebru Arisoy, Vesa Siivola, Teemu Hirsimäki, Janne Pylkkönen, Tanel Alumäe, and Murat Saraclar, · 2007
Earlier work this paper cites.
“Recurrent Neural Network based Language Model,”
T Mikolov, M Karafiat, L Burget, J Cernocky, and S Khudanpur, · 2010
Earlier work this paper cites.
“Improved Recognition of Spontaneous Hungarian Speech—Morphological and Acoustic Modeling Techniques for a Less Resourced Task,”
Péter Mihajlik, Zoltán Tüske, Balázs Tarján, Bottyán Németh, and Tibor Fegyó, · 2010
Earlier work this paper cites.
“Variational approximation of long-span language models for LVCSR,”
Anoop Deoras, Tomas Mikolov, Stefan Kombrink, Martin Karafiat, and Sanjeev Khudanpur, · 2011
Earlier work this paper cites.
“The Kaldi Speech Recognition Toolkit,”
Daniel Povey, Arnab Ghoshal, Gilles Boulianne, Lukas Burget, Ondrej Glembek, Nagendra Goel, Mirko Hannemann, Petr Motlicek, Yanmin Qian, Petr Schwarz, Jan Silovsky, Georg Stemmer, and Karel Vesely, · 2011
Earlier work this paper cites.
“Evaluation of lexical models for Hungarian Broadcast speech transcription and spoken term detection,”
Balázs Tarján, Péter Mihajlik, András Balog, and Tibor Fegyó, · 2011
Cited alongside, same era.
“LSTM Neural Networks for Language Modeling,”
Martin Sundermeyer, Ralf Schlueter, and Hermann Ney, · 2012
Cited alongside, same era.
“Morfessor 2.0: Python Implementation and Extensions for Morfessor Baseline,”
Sami Virpioja, Peter Smit, Stig-Arne Grönroos, and Mikko Kurimo, · 2013
Cited alongside, same era.
“Converting neural network language models into back-off language models for efficient decoding in automatic speech recognition,”
Ebru Arisoy, Stanley F. Chen, Bhuvana Ramabhadran, and Abhinav Sethy, · 2014
Cited alongside, same era.
“Comparing approaches to convert recurrent neural networks into backoff language models for efficient decoding,”
Heike Adel, Katrin Kirchhoff, Ngoc Thang Vu, Dominic Telaar, and Tanja Schultz, · 2014
Cited alongside, same era.
“Language Modeling with Deep Transformers,”
Kazuki Irie, Albert Zeyer, Ralf Schlüter, and Hermann Ney, · 2019
Later among the works it cites.
“Subword RNNLM Approximations for Out-Of-Vocabulary Keyword Search,”
Mittul Singh, Sami Virpioja, Peter Smit, and Mikko Kurimo, · 2019
Later among the works it cites.
“Improvements to N-gram Language Model Using Text Generated from Neural Language Model,”
Masayuki Suzuki, Nobuyasu Itoh, Tohru Nagano, Gakuto Kurata, and Samuel Thomas, · 2019
Later among the works it cites.
“Improving N-gram Language Models with Pre-trained Deep Transformer,”
Yiren Wang, Hongzhao Huang, Zhe Liu, Yutong Pang, Yongqiang Wang, ChengXiang Zhai, and Fuchun Peng, · 2019
Later among the works it cites.
“Investigating Sub-Word Embedding Strategies for the Morphologically Rich and Free Phrase-Order Hungarian,”
Bálint Döbrössy, Márton Makrai, Balázs Tarján, and György Szaszák, · 2019
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
“Adam: A Method for Stochastic Optimization,”
Diederik P. Kingma and Jimmy Ba, · 2014
Cited alongside, same era.
“Neural Machine Translation of Rare Words with Subword Units,”
Rico Sennrich, Barry Haddow, and Alexandra Birch, · 2016
Cited alongside, same era.
“Attention is all you need,”
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin, · 2017
Cited alongside, same era.
“Semi-Orthogonal Low-Rank Matrix Factorization for Deep Neural Networks,”
Daniel Povey, Gaofeng Cheng, Yiming Wang, Ke Li, Hainan Xu, Mahsa Yarmohammadi, and Sanjeev Khudanpur, · 2018
Cited alongside, same era.
Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever, · 2019
Later among the works it cites.
“XLNet: Generalized Autoregressive Pretraining for Language Understanding,”
Zhilin Yang, Zihang Dai, Yiming Yang, Jaime Carbonell, Ruslan Salakhutdinov, and Quoc V. Le, · 2019
Later among the works it cites.
“HuggingFace’s Transformers: State-of-the-art Natural Language Processing,”
Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pierric Cistac, Tim Rault, R’emi Louf, Morgan Funtowicz, and Jamie Brew, · 2019
Later among the works it cites.
“Investigation on N-gram Approximated RNNLMs for Recognition of Morphologically Rich Speech,”
Balázs Tarján, György Szaszák, Tibor Fegyó, and Péter Mihajlik, · 2019
Later among the works it cites.