Fetching the paper…
Reading the bibliography…
One of the main problems encountered so far with recurrent neural networks is that they struggle to retain long-time information dependencies in their recurrent connections.
On computable numbers, with an application to the entscheidungsproblem
A. M. Turing · 1937
Earlier work this paper cites.
The magical number seven, plus or minus two: Some limits on our capacity for processing information
G. A. Miller · 1956
Earlier work this paper cites.
Working memory , volume 8, pages 47–90
A. D Baddeley and G. J. Hitch · 1974
Earlier work this paper cites.
Algebraic complexity theory
Joachim von zur Gathen · 1988
Earlier work this paper cites.
On the computational power of neural nets
H. T. Siegelmann and E. D. Sontag · 1992
Earlier work this paper cites.
Optimal depth neural networks for multiplication and related problems
K. Y. Siu and V. Roychowdhury · 1993
Earlier work this paper cites.
Depth-optimal O(n)-node neural networks for n-bit addition
P. Gupta and P. G. Poonacha · 1996
Earlier work this paper cites.
Long short-term memory
S. Hochreiter and J. Schmidhuber · 1997
Earlier work this paper cites.
Solving arithmetic problems using feed-forward neural networks
L. Franco and S. A. Cannas · 1998
Earlier work this paper cites.
Memory and the computational brain, 2009
C. R. Gallister and A. P. King · 2009
Earlier work this paper cites.
The problem of rapid variable creation
R. F. Hadley · 2009
Cited alongside, same era.
Understanding the exploding gradient problem
R. Pascanu, T. Mikolov, and Y. Bengio · 2012
Cited alongside, same era.
A novel neural network parallel adder
F. Chen, G. Wang, G. Chen, and Q. He · 2013
Cited alongside, same era.
Neural network binary multiplier
H. Huang, F. Chen, and L. Xu · 2013
Cited alongside, same era.
Neural turing machines, 2014
A. Graves, G. Wayne, and I. Danihelka · 2014
Cited alongside, same era.
J. Weston, S. Chopra, and A. Bordes · 2014
Cited alongside, same era.
Reinforcement learning neural turing machines
W. Zaremba and I. Sutskever · 2015
Later among the works it cites.
Learning simple algorithms from examples
W. Zaremba, T. Mikolov, A. Joulin, and R. Fergus · 2015
Later among the works it cites.
Structured memory for neural turing machines
W. Zhang, Y. Yu, and B. Zhou · 2015
Later among the works it cites.
Dynamic neural turing machine with soft and hard addressing schemes
Ç. Gülçehre, S. Chandar, K. Cho, and Y. Bengio · 2016
Later among the works it cites.
Evolving neural turing machines for reward-based learning
R. B. Greve, E. J. Jacobsen, and S. Risi · 2016
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
RMSProp and equilibrated adaptive learning rates for non-convex optimization
Y. N. Dauphin, H. de Vries, J. Chung, and Y. Bengio · 2015
Cited alongside, same era.
L. Kaiser and I. Sutskever · 2015
Cited alongside, same era.
Deep learning in neural networks: an overview
J. Schmidhuber · 2015
Cited alongside, same era.
G. Yang · 2016
Later among the works it cites.
Structured neural turing machine
H Liu, X. Yang, and Z. Xu · 2017
Later among the works it cites.
Implementing neural turing machines
M. Collier and J. Beel · 2018
Later among the works it cites.
Backpropagation through time and the brain
T. P. Lillicrap and A. Santoro · 2019
Closest in time.