First-Pass Large Vocabulary Continuous Speech Recognition using Bi-Directional Recurrent DNNs

Long short-term memory

Hochreiter, S. and Schmidhuber, J · 1997

Earlier work this paper cites.

Connectionist temporal classification: Labelling unsegmented sequence data with recurrent neural networks

Graves, A., Fernández, S., Gomez, F., and Schmidhuber, J · 2006

Earlier work this paper cites.

Deep Sparse Rectifier Networks

Glorot, X., Bordes, A., and Bengio, Y · 2011

Earlier work this paper cites.

The kaldi speech recognition toolkit

Povey, D., Ghoshal, A., Boulianne, G., Burget, L., Glembek, O., Veselý, K., Goel, N., Hannemann, M., Motlicek, P., Qian, Y., Schwarz, P., Silovsky, J., and Stemmer, G · 2011

Earlier work this paper cites.

Deep Neural Networks for Acoustic Modeling in Speech Recognition

Hinton, G.E., Deng, L., Yu, D., Dahl, G.E., Mohamed, A., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., and Kingsbury, B · 2012

Cited alongside, same era.

Improving Deep Neural Networks for LVCSR using Rectified Linear Units and Dropout

Dahl, G.E., Sainath, T.N., and Hinton, G.E · 2013

Cited alongside, same era.

Rectifier Nonlinearities Improve Neural Network Acoustic Models

Maas, A., Hannun, A., and Ng, A · 2013

Cited alongside, same era.

On the Importance of Momentum and Initialization in Deep Learning

Sutskever, I., Martens, J., Dahl, G., and Hinton, G · 2013

Later among the works it cites.

On Rectified Linear Units for Speech Processing

Zeiler, M.D., Ranzato, M., Monga, R., Mao, M., Yang, K., Le, Q.V., Nguyen, P., Senior, A., Vanhoucke, V., Dean, J., and Hinton, G.E · 2013

Later among the works it cites.

Towards End-to-End Speech Recognition with Recurrent Neural Networks

Graves, A. and Jaitly, N · 2014

Closest in time.