Fetching the paper…
Reading the bibliography…
State-of-the-art solutions in the areas of "Language Modelling & Generating Text", "Speech Recognition", "Generating Image Descriptions" or "Video Tagging" have been using Recurrent Neural Networks as the foundation for their approaches.
“An Efficient Gradient-Based Algorithm for On-Line Training of Recurrent Network Trajectories”
R.. Williams and J. Peng · 1990
Earlier work this paper cites.
“Learning long-term dependencies with gradient descent is difficult”
Y. Bengio, Patrice Simard and Paolo Frasconi · 1994
Earlier work this paper cites.
“Long Short-term Memory”
Sepp Hochreiter and J\"urgen Schmidhuber · 1997
Earlier work this paper cites.
“Bidirectional recurrent neural networks”
Mike Schuster and Kuldip. Paliwal · 1997
Earlier work this paper cites.
“Training Recurrent Neural Networks” AAINS22066
Ilya Sutskever · 2013
Earlier work this paper cites.
“Neural Machine Translation by Jointly Learning to Align and Translate”, 2014
Dzmitry Bahdanau, Kyunghyun Cho and Yoshua Bengio · 2014
Earlier work this paper cites.
“Neural Turing Machines”, 2014
Alex Graves, Greg Wayne and Ivo Danihelka · 2014
Earlier work this paper cites.
“Sequence to Sequence Learning with Neural Networks”
Ilya Sutskever, Oriol Vinyals and Quoc Le · 2014
Earlier work this paper cites.
“Neural Machine Translation by Jointly Learning to Align and Translate”
Dzmitry Bahdanau, Kyunghyun Cho and Yoshua Bengio · 2015
Earlier work this paper cites.
“Effective Approaches to Attention-based Neural Machine Translation”, 2015
Minh-Thang Luong, Hieu Pham and Christopher. Manning · 2015
Cited alongside, same era.
“Effective Approaches to Attention-based Neural Machine Translation”
Thang Luong, Hieu Pham and Christopher. Manning · 2015
Cited alongside, same era.
“Sequence to Sequence – Video to Text”
S. Venugopalan et al · 2015
Cited alongside, same era.
“Pointer Networks”
Oriol Vinyals, Meire Fortunato and Navdeep Jaitly · 2015
Cited alongside, same era.
“A Gentle Tutorial of Recurrent Neural Network with Error Backpropagation”, 2016
Gang Chen · 2016
Cited alongside, same era.
“Introduction to pointer networks” Accessed: 22 November 2019, 2017
Z. Zygmunt · 2017
Later among the works it cites.
“The Illustrated Transformer”, 2018
Jay Alammar · 2018
Later among the works it cites.
“Visualizing A Neural Machine Translation Model (Mechanics of Seq2seq Models With Attention)”, 2018
Jay Alammar · 2018
Later among the works it cites.
“Attention? Attention!” Accessed: 09 November 2019
Lilian Weng · 2018
Later among the works it cites.
“A Beginner’s Guide to LSTMs and Recurrent Neural Networks” Accessed: 06 November 2019, https://skymind.ai/wiki/lstm , 2019
Chris Nicholson · 2019
Closest in time.
“Grandmaster level in StarCraft II using multi-agent reinforcement learning”
Oriol Vinyals et al · 2019
Closest in time.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Yonghui Wu et al · 2016
Cited alongside, same era.
“A Comparison of Sequence-to-Sequence Models for Speech Recognition”
Rohit Prabhavalkar et al · 2017
Cited alongside, same era.
“Attention is All you Need”
Ashish Vaswani et al · 2017
Cited alongside, same era.
“Dive into Deep Learning” http://www.d2l.ai , 2019
Aston Zhang, Zachary. Lipton, Mu Li and Alexander. Smola · 2019
Closest in time.
“Gated Feedback Recurrent Neural Networks”
Junyoung Chung, Caglar Gulcehre, Kyunghyun Cho and Yoshua Bengio · 2075
Closest in time.