Machine Learning on Sequential Data Using a Recurrent Weighted Average

Untersuchungen zu dynamischen neuronalen Netzen

Sepp Hochreiter · 1991

Earlier work this paper cites.

Learning long-term dependencies with gradient descent is difficult

Yoshua Bengio, Patrice Simard, and Paolo Frasconi · 1994

Earlier work this paper cites.

Long short-term memory

Sepp Hochreiter and Jürgen Schmidhuber · 1997

Earlier work this paper cites.

Gradient-based learning applied to document recognition

Yann LeCun, Léon Bottou, Yoshua Bengio, and Patrick Haffner · 1998

Earlier work this paper cites.

Learning to forget: Continual prediction with lstm

Felix A Gers, Jürgen Schmidhuber, and Fred Cummins · 2000

Earlier work this paper cites.

Understanding the difficulty of training deep feedforward neural networks

Xavier Glorot and Yoshua Bengio · 2010

Cited alongside, same era.

Neural machine translation by jointly learning to align and translate

Original

Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio · 2014

Cited alongside, same era.

Adam: A method for stochastic optimization

Original

Diederik Kingma and Jimmy Ba · 2014

Cited alongside, same era.

Listen, attend and spell

Original

William Chan, Navdeep Jaitly, Quoc V Le, and Oriol Vinyals · 2015

Cited alongside, same era.

An empirical exploration of recurrent network architectures

Rafal Jozefowicz, Wojciech Zaremba, and Ilya Sutskever · 2015

Cited alongside, same era.

Grammar as a foreign language

Oriol Vinyals, Łukasz Kaiser, Terry Koo, Slav Petrov, Ilya Sutskever, and Geoffrey Hinton

Cited in the paper.

Show and tell: A neural image caption generator

Oriol Vinyals, Alexander Toshev, Samy Bengio, and Dumitru Erhan

Cited in the paper.

A simple way to initialize recurrent networks of rectified linear units

Original

Quoc V Le, Navdeep Jaitly, and Geoffrey E Hinton · 2015

Later among the works it cites.

Convolutional lstm networks for subcellular localization of proteins

Søren Kaae Sønderby, Casper Kaae Sønderby, Henrik Nielsen, and Ole Winther · 2015

Later among the works it cites.

Show, attend and tell: Neural image caption generation with visual attention

Kelvin Xu, Jimmy Ba, Ryan Kiros, Kyunghyun Cho, Aaron C Courville, Ruslan Salakhutdinov, Richard S Zemel, and Yoshua Bengio · 2015

Later among the works it cites.

Tensorflow: Large-scale machine learning on heterogeneous distributed systems

Original

Abadi et al · 2016

Later among the works it cites.

Recurrent orthogonal networks and long-memory tasks

Mikael Henaff, Arthur Szlam, and Yann LeCun · 2016

Later among the works it cites.