Speech Recognition with Deep Recurrent Neural Networks

Learning representations by back-propagating errors

David E. Rumelhart, Geoffrey E. Hinton, and Ronald J. Williams, · 1988

Earlier work this paper cites.

“Speaker-independent phone recognition using hidden markov models,”

Kai fu Lee and Hsiao wuen Hon, · 1989

Earlier work this paper cites.

The DARPA TIMIT Acoustic-Phonetic Continuous Speech Corpus (TIMIT)

DARPA-ISTO, · 1990

Earlier work this paper cites.

“Keeping the neural networks simple by minimizing the description length of the weights,”

Geoffrey E. Hinton and Drew van Camp, · 1993

Earlier work this paper cites.

Connnectionist Speech Recognition: A Hybrid Approach

H.A. Bourlard and N. Morgan, · 1994

Earlier work this paper cites.

“An Application of Recurrent Nets to Phone Probability Estimation,”

A. J. Robinson, · 1994

Earlier work this paper cites.

“Forward-backward retraining of recurrent neural networks,”

Andrew W. Senior and Anthony J. Robinson, · 1995

Earlier work this paper cites.

“An analysis of noise in recurrent neural networks: convergence and generalization,”

Kam-Chuen Jim, C.L. Giles, and B.G. Horne, · 1996

Earlier work this paper cites.

“Long Short-Term Memory,”

S. Hochreiter and J. Schmidhuber, · 1997

Earlier work this paper cites.

“Bidirectional Recurrent Neural Networks,”

M. Schuster and K. K. Paliwal, · 1997

Cited alongside, same era.

“Learning Precise Timing with LSTM Recurrent Networks,”

F. Gers, N. Schraudolph, and J. Schmidhuber, · 2002

Cited alongside, same era.

“Tandem connectionist feature extraction for conversational speech recognition,”

Qifeng Zhu, Barry Chen, Nelson Morgan, and Andreas Stolcke, · 2005

Cited alongside, same era.

“Framewise Phoneme Classification with Bidirectional LSTM and Other Neural Network Architectures,”

A. Graves and J. Schmidhuber, · 2005

Cited alongside, same era.

“Connectionist Temporal Classification: Labelling Unsegmented Sequence Data with Recurrent Neural Networks,”

A. Graves, S. Fernández, F. Gomez, and J. Schmidhuber, · 2006

Cited alongside, same era.

“Unconstrained Online Handwriting Recognition with Recurrent Neural Networks,”

“Discriminatively estimated joint acoustic, duration, and language model for speech recognition,”

M. Lehr and I. Shafran, · 2010

Later among the works it cites.

“Practical variational inference for neural networks,”

Alex Graves, · 2011

Later among the works it cites.

“Acoustic modeling using deep belief networks,”

A. Mohamed, G.E. Dahl, and G. Hinton, · 2012

Later among the works it cites.

“Deep neural networks for acoustic modeling in speech recognition,”

G. Hinton, Li Deng, Dong Yu, G.E. Dahl, A. Mohamed, N. Jaitly, A. Senior, V. Vanhoucke, P. Nguyen, T.N. Sainath, and B. Kingsbury, · 2012

Later among the works it cites.

“Revisiting Recurrent Neural Networks for Robust ASR,”

Oriol Vinyals, Suman Ravuri, and Daniel Povey, · 2012

Later among the works it cites.

“Recurrent neural networks for noise reduction in robust asr,”

A. Maas, Q. Le, T. O’Neil, O. Vinyals, P. Nguyen, and A. Ng, · 2012