Recurrent Spatial Transformer Networks

Theano: new features and speed improvements

Original

Bastien, Frédéric, Lamblin, Pascal, Pascanu, Razvan, Bergstra, James, Goodfellow, Ian, Bergeron, Arnaud, Bouchard, Nicolas, Warde-Farley, David, and Bengio, Yoshua · 2012

Earlier work this paper cites.

{Lecture 6.5—RmsProp: Divide the gradient by a running average of its recent magnitude}, 2012

Tieleman, T and Hinton, Geoffrey E · 2012

Earlier work this paper cites.

Multiple Object Recognition with Visual Attention

Ba, Jimmy, Mnih, Volodymyr, and Kavukcuoglu, Koray · 2014

Earlier work this paper cites.

Neural Machine Translation by Jointly Learning to Align and Translate

Bahdanau, Dzmitry, Cho, Kyunghyun, and Bengio, Yoshua · 2014

Earlier work this paper cites.

End-to-end Continuous Speech Recognition using Attention-based Recurrent NN: First Results

Chorowski, Jan, Bahdanau, Dzmitry, Cho, Kyunghyun, and Bengio, Yoshua · 2014

Cited alongside, same era.

Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling

Original

Chung, Junyoung, Gulcehre, Caglar, Cho, KyungHyun, and Bengio, Yoshua · 2014

Cited alongside, same era.

Recurrent Models of Visual Attention

Mnih, Volodymyr, Heess, Nicolas, Graves, Alex, and Kavukcuoglu, Koray · 2014

Cited alongside, same era.

Lasagne: First release., August 2015

Dieleman, Sander, Schlüter, Jan, Raffel, Colin, Olson, Eben, Sønderby, Søren Kaae, Nouri, Daniel, Battenberg, Eric, van den Oord, Aäron, and other contributors · 2015

Cited alongside, same era.

Attention for Fine-Grained Categorization

Sermanet, Pierre, Frome, Andrea, and Real, Esteban

Cited in the paper.

DRAW: A Recurrent Neural Network For Image Generation

Original

Gregor, Karol, Danihelka, Ivo, Graves, Alex, and Wierstra, Daan · 2015

Closest in time.

Spatial Transformer Networks

Jaderberg, M and Simonyan, K · 2015

Closest in time.

Show, Attend and Tell: Neural Image Caption Generation with Visual Attention

Original

Xu, Kelvin, Ba, Jimmy, Kiros, Ryan, Cho, Kyunghyun, Courville, Aaron, Salakhutdinov, Ruslan, Zemel, Richard, and Bengio, Yoshua · 2015

Closest in time.