Fetching the paper…
Reading the bibliography…
We propose to train bi-directional neural network language model(NNLM) with noise contrastive estimation(NCE).
“An empirical study of smoothing techniques for language modeling,”
Stanley F. Chen and Joshua Goodman, · 1996
Earlier work this paper cites.
“Long short-term memory,”
Sepp Hochreiter and Jürgen Schmidhuber, · 1997
Earlier work this paper cites.
“Gradient flow in recurrent nets: the difficulty of learning long-term dependencies,” 2001
Sepp Hochreiter, Yoshua Bengio, Paolo Frasconi, and Jürgen Schmidhuber, · 2001
Earlier work this paper cites.
“Srilm-an extensible language modeling toolkit,”
Andreas Stolcke, · 2002
Earlier work this paper cites.
“A neural probabilistic language model,”
Yoshua Bengio, Rejean Ducharme, Pascal Vincent, and Christian Jauvin, · 2003
Earlier work this paper cites.
“Hierarchical probabilistic neural network language model,”
Frederic Morin and Yoshua Bengio, · 2005
Earlier work this paper cites.
“Continuous space language models,”
Holger Schwenk, · 2007
Earlier work this paper cites.
“Three new graphical models for statistical language modelling,”
Andriy Mnih and Geoffrey Hinton, · 2007
Earlier work this paper cites.
“Improved neural network based language modelling andadaptation,”
J. Park, X. Liu, M. J. F. Gales, and P. C. Woodland, · 2010
Earlier work this paper cites.
“Recurrent neural network based language model,”
Tomas Mikolov, Martin Karafiat, Lukas Burget, Jan Cernocky, and Sanjeev Khudanpur, · 2010
Cited alongside, same era.
Microsoft Research Technical Report
“The microsoft research sentence completion challenge,” · 2011
Cited alongside, same era.
“Lstm neural networks for language modeling,”
Martin Sundermeyer, Ralf Schluter, and Hermann Ney, · 2012
Cited alongside, same era.
“Noise-contrastive estimation of unnormalized statistical models, with applications to natural image statistics,”
Michael U. Gutmann and Aapo Hyvärinen, · 2012
Cited alongside, same era.
“A fast and simple algorithm for training neural probabilistic language models,”
Andriy Mnih and Yee Whye Teh, · 2012
Cited alongside, same era.
“Comparison of feedforward and recurrent neural network language models,”
Martin Sundermeyer, Ilya Oparin, Ben Freiberg, Ralf Schlüter, and Hermann Ney, · 2013
“Recurrent neural network regularization,”
Wojciech Zaremba, Ilya Sutskever, and Oriol Vinyals, · 2014
Later among the works it cites.
“Empirical evaluation of gated recurrent neural networks on sequence modeling,”
Junyoung Chung, Çaglar Gülçehre, KyungHyun Cho, and Yoshua Bengio, · 2014
Later among the works it cites.
“Towards end-to-end speech recognition with recurrent neural networks,”
Alex Graves and Navdeep Jaitly, · 2014
Later among the works it cites.
Microsoft Research Technical Report
“An introduction to computational networks and the computational network toolkit,” · 2014
Later among the works it cites.
“Feedforward sequential memory neural networks without recurrent feedback,”
Shiliang Zhang, Hui Jiang, Si Wei, and Li-Rong Dai, · 2015
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
“Cache based recurrent neural network language model inference for first pass speech recognition,”
Zhiheng Huang, Geoffrey Zweig, and Benoit Dumoulin, · 2014
Cited alongside, same era.
“Efficient lattice rescoring using recurrent neural network language models,”
X. Liu, Y. Wang, X. Chen, M. J. F. Gales, and P. C. Woodland, · 2014
Cited alongside, same era.
“Efficient gpu-based training of recurrent neural network language models using spliced sentence bunch,”
X. Chen, Y. Wang, X. Liu, M.J.F. Gales, and P. C. Woodland, · 2014
Cited alongside, same era.
“Bidirectional recurrent neural network language models for automatic speech recognition,”
Ebru Arisoy1, Abhinav Sethy, Bhuvana Ramabhadran, and Stanley Chen, · 2015
Later among the works it cites.
“Bidirectional recurrent neural networks as generative models - reconstructing gaps in time series,”
Mathias Berglund, Tapani Raiko, Mikko Honkala, Leo Kärkkäinen, Akos Vetek, and Juha Karhunen, · 2015
Later among the works it cites.
“Recurrent neural network language model training with noise contrastive estimation for speech recognition,”
M. J. F. Gales X. Chen, X. Liu and P. C.Woodland, · 2015
Later among the works it cites.