Depth-Gated LSTM

“Finding structure in time,”

J. Elman, · 1990

Earlier work this paper cites.

“Serial order: a parallel distributed processing approach,”

M. Jordan, · 1997

Earlier work this paper cites.

“Long short-term memory,”

S. Hochreiter and J. Schmidhuber, · 1997

Earlier work this paper cites.

“Learning to forget: Continual prediction with LSTM,”

F. A. Gers, J. Schmidhuber, and F. Cummins, · 1999

Earlier work this paper cites.

“Recurrent neural network based language model,”

T. Mikolov, M. Karafiat, L. Burget, J. Cernocky, and S. Khudanpur, · 2010

Earlier work this paper cites.

“Deep neural networks for acoustic modeling in speech recognition,”

G. Hinton, L. Deng, D. Yu, G. Dahl, A. r. Mohamed, N. Jaitly, A. Senior, V. Vanhoucke, P. Nguyen, and T. Sainath and. B. Kingsbury, · 2012

Cited alongside, same era.

“Imagenet classification with deep convolution neural networks,”

A Krizhevsky, I Sutskever, and G Hinton, · 2012

Cited alongside, same era.

“Generating sequences with recurrent neural networks,”

Original

A. Graves, · 2013

Cited alongside, same era.

“How to construct deep recurrent neural networks,”

Original

R. Pascanu, C. Gulcehre, K. Cho, and Y. Bengio, · 2013

Cited alongside, same era.

“On the properties of neural machine translation,”

K. Cho, B. van Merrienboer, D. Bahdanau, and Y. Bengio, · 2014

Cited alongside, same era.

“Neural machine translation by jointly learning to align and translate,”

Original

D. Bahdanau, K. Cho, and Y. Bengio, · 2014

Later among the works it cites.

“Sequence to sequence learning with neural networks,”

I. Sutskever, O. Vinyals, and Q.V. Le, · 2014

Later among the works it cites.

“Highway networks,”

Original

R. K. Srivastava, K. Greff, and Jurgen Schmidhuber, · 2015

Closest in time.

“Grid long short-term memory,”

Original

Nal Kalchbrenner, Ivo Danihelka, and Alex Graves, · 2015

Closest in time.