Fetching the paper…
Reading the bibliography…
Neural dynamical systems with stable attractor structures, such as point attractors and continuous attractors, are hypothesized to underlie meaningful temporal behavior that requires working memory.
Localization of high-frequency tones
W E Feddersen, T T Sandel, D C Teas, and others · 1957
Earlier work this paper cites.
Mathematical theory of optimal processes
Lev Semenovich Pontryagin, Vladimir Grigorevich Boltyanskii, Revaz Valerianovich Gamkrelidze, and Evgenii Frolovich Mishchenko · 1964
Earlier work this paper cites.
Finite Dimensional Linear Systems
Roger W Brockett · 1970
Earlier work this paper cites.
Stochastic models of neuroelectric activity
J D Cowan · 1972
Earlier work this paper cites.
Excitatory and inhibitory interactions in localized populations of model neurons
H R Wilson and J D Cowan · 1972
Earlier work this paper cites.
Mass Action in the Nervous System
Walter J Freeman · 1975
Earlier work this paper cites.
Lyapunov characteristic exponents for smooth dynamical systems and for Hamiltonian systems; a method for computing all of them. part 1: Theory
Giancarlo Benettin, Luigi Galgani, Antonio Giorgilli, and Jean-Marie Strelcyn · 1980
Earlier work this paper cites.
Nonlinear Oscillations, Dynamical Systems, and Bifurcations of Vector Fields
John Guckenheimer and Philip Holmes · 1983
Earlier work this paper cites.
At least one Lyapunov exponent vanishes if the trajectory of an attractor does not contain a fixed point
H Haken · 1983
Earlier work this paper cites.
Neurons with graded response have collective computational properties like those of two-state neurons, 1984
J J Hopfield · 1984
Earlier work this paper cites.
Society Of Mind
Marvin Minsky · 1988
Earlier work this paper cites.
Phasor neural networks
André J Noest · 1988
Earlier work this paper cites.
Modeling Brain Function: The World of Attractor Neural Networks
Daniel J Amit · 1989
Earlier work this paper cites.
The storage of time intervals using oscillating neurons
Christopher Miall · 1989
Earlier work this paper cites.
Phoneme recognition using time-delay neural networks
A Waibel, T Hanazawa, G Hinton, K Shikano, and K J Lang · 1989
Earlier work this paper cites.
A learning algorithm for continually running fully recurrent neural networks
Ronald J Williams and David Zipser · 1989
Earlier work this paper cites.
A circuit for detection of interaural time differences in the brain stem of the barn owl
C E Carr and M Konishi · 1990
Earlier work this paper cites.
30 years of adaptive neural networks: perceptron, Madaline, and backpropagation
Bernard Widrow and Michael A Lehr · 1990
Earlier work this paper cites.
Adjoint-functions and temporal learning algorithms in neural networks
N Toomarian and J Barhen · 1991
Earlier work this paper cites.
The gamma model—a new neural model for temporal processing
Bert de Vries and José C Príncipe · 1992
Earlier work this paper cites.
Bifurcations in the learning of recurrent neural networks
K Doya · 1992
Earlier work this paper cites.
Bifurcations of recurrent neural networks in gradient descent learning
K Doya · 1993
Earlier work this paper cites.
Learning long-term dependencies with gradient descent is difficult
Y Bengio, P Simard, and P Frasconi · 1994
Earlier work this paper cites.
Gradient descent learning algorithm overview: a general dynamical systems perspective
Pierre Baldi · 1995
Earlier work this paper cites.
On the dynamics of small Continuous-Time recurrent neural networks
Randall D Beer · 1995
Earlier work this paper cites.
Elements of Applied Bifurcation Theory
Yuri A Kuznetsov · 1995
Earlier work this paper cites.
Applied Nonlinear Dynamics: Analytical, Computational, and Experimental Methods
Ali H Nayfeh and Balakumar Balachandran · 1995
Earlier work this paper cites.
A model of the neural basis of the rat’s sense of direction
W E Skaggs, J J Knierim, H S Kudrimoti, and B L McNaughton · 1995
Earlier work this paper cites.
How the brain keeps the eyes still
H Sebastian Seung · 1996
Earlier work this paper cites.
Kechen Zhang · 1996
Earlier work this paper cites.
Long short-term memory
S Hochreiter and J Schmidhuber · 1997
Earlier work this paper cites.
A model of visuospatial working memory in prefrontal cortex: recurrent network and cellular bistability
M Camperi and X J Wang · 1998
Earlier work this paper cites.
A role for NMDA-receptor channels in working memory
J E Lisman, J M Fellous, and X J Wang · 1998
Earlier work this paper cites.
Neuronal correlates of parametric working memory in the prefrontal cortex
R Romo, C D Brody, A Hernández, and L Lemus · 1999
Earlier work this paper cites.
Stability of the memory of eye position in a recurrent network of conductance-based model neurons
H S Seung, D D Lee, B Y Reis, and D W Tank · 2000
Earlier work this paper cites.
Nonlinear dynamics and chaos : with applications to physics, biology, chemistry, and engineering
Steven H Strogatz · 2000
Earlier work this paper cites.
Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems
Peter Dayan and L F Abbott · 2001
Earlier work this paper cites.
Neural computations that underlie decisions about sensory stimuli
J I Gold and M N Shadlen · 2001
Earlier work this paper cites.
Gradient flow in recurrent nets: The difficulty of learning long-term dependencies
Sepp Hochreiter, Yoshua Bengio, Paolo Frasconi, and Jürgen Schmidhuber · 2001
Earlier work this paper cites.
Model for a robust neural integrator
Alexei A Koulakov, Sridhar Raghavachari, Adam Kepecs, and John E Lisman · 2002
Earlier work this paper cites.
Real-Time computing without stable states: A new framework for neural computation based on perturbations
Wolfgang Maass, Thomas Natschläger, and Henry Markram · 2002
Earlier work this paper cites.
Probabilistic decision making by slow reverberation in cortical circuits
Xiao-Jing Wang · 2002
Earlier work this paper cites.
Robust spatial working memory through homeostatic synaptic scaling in heterogeneous cortical networks
Alfonso Renart, Pengcheng Song, and Xiao-Jing Wang · 2003
Cited alongside, same era.
What makes us tick? Functional and neural mechanisms of interval timing
Catalin V Buhusi and Warren H Meck · 2005
Cited alongside, same era.
Flexible control of mutual inhibition: A neural model of Two-Interval discrimination
Christian K Machens, Ranulfo Romo, and Carlos D Brody · 2005
Cited alongside, same era.
Neural correlations, population coding and computation
Bruno B Averbeck, Peter E Latham, and Alexandre Pouget · 2006
Cited alongside, same era.
Smooth ergodic theory and nonuniformly hyperbolic dynamics
Luis Barreira and Yakov Pesin · 2006
Cited alongside, same era.
Ordinary Differential Equations with Applications
Carmen Chicone · 2006
Attention is all you need
Ashish Vaswani, Noam Shazeer, Niki Parmar, et al · 2017
Later among the works it cites.
On orthogonality and learning recurrent networks with long term dependencies
Eugene Vorontsov, Chiheb Trabelsi, Samuel Kadoury, and Chris Pal · 2017
Later among the works it cites.
Dynamical isometry and a mean field theory of RNNs: Gating enables signal propagation in recurrent neural networks
Minmin Chen, Jeffrey Pennington, and Samuel S Schoenholz · 2018
Later among the works it cites.
How to start training: The effect of initialization and architecture
Boris Hanin and David Rolnick · 2018
Later among the works it cites.
Principles of insect path integration
Stanley Heinze, Ajay Narendra, and Allen Cheung · 2018
Later among the works it cites.
Gradient descent for spiking neural networks
Dongsung Huh and Terrence J Sejnowski · 2018
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
Reducing the dimensionality of data with neural networks
G E Hinton and R R Salakhutdinov · 2006
Cited alongside, same era.
Dynamical systems in neuroscience : the geometry of excitability and bursting
Eugene M Izhikevich · 2007
Cited alongside, same era.
Special issue on echo state networks and liquid state machines
Herbert Jaeger, Wolfgang Maass, and José C Príncipe · 2007
Cited alongside, same era.
Analysis and design of echo state networks
Mustafa C Ozturk, Dongming Xu, and José C Príncipe · 2007
Cited alongside, same era.
Grid cells and theta as oscillatory interference: theory and predictions
Neil Burgess · 2008
Cited alongside, same era.
Unstable solutions of nonautonomous linear differential equations
K Josić and R Rosenbaum · 2008
Cited alongside, same era.
Later among the works it cites.
AntisymmetricRNN: A dynamical system view on recurrent neural networks
Bo Chang, Minmin Chen, Eldad Haber, and Ed H Chi · 2019
Later among the works it cites.
Self-organized reactivation maintains and reinforces memories despite synaptic turnover
Michael Jan Fauth and Mark Cw van Rossum · 2019
Later among the works it cites.
Robust computation with rhythmic spike patterns
E Paxon Frady and Friedrich T Sommer · 2019
Later among the works it cites.
ANODE: Unconditionally accurate Memory-Efficient gradients for neural ODEs
Amir Gholami, Kurt Keutzer, and George Biros · 2019
Later among the works it cites.
personal communication, 2019
Dongsung Huh · 2019
Later among the works it cites.
A unified framework of online learning algorithms for training recurrent neural networks
Owen Marschall, Kyunghyun Cho, and Cristina Savin · 2019
Later among the works it cites.
Local online learning in recurrent networks with random feedback
James M Murray · 2019
Later among the works it cites.
PyTorch: An imperative style, High-Performance deep learning library
Adam Paszke, Sam Gross, Francisco Massa, et al · 2019
Later among the works it cites.
A deep learning framework for neuroscience
Blake A Richards, Timothy P Lillicrap, Philippe Beaudoin, et al · 2019
Later among the works it cites.
Kernel RNN learning (KeRNL)
Christopher Roth, Ingmar Kanitscheider, and Ila Fiete · 2019
Later among the works it cites.
Adjoint dynamics of stable limit cycle neural networks
Piotr Sokol, Ian Jordan, Eben Kadile, and Il Memming Park · 2019
Later among the works it cites.
A solution to the learning dilemma for recurrent networks of spiking neurons
Guillaume Bellec, Franz Scherr, Anand Subramoney, et al · 2020
Later among the works it cites.
The neural basis for a persistent internal state in Drosophila females
David Deutsch, Diego Pacheco, Lucas Encarnacion-Rivera, et al · 2020
Later among the works it cites.
Backpropagation and the brain
Timothy P Lillicrap, Adam Santoro, Luke Marris, Colin J Akerman, and Geoffrey Hinton · 2020
Later among the works it cites.
Information geometry of orthogonal initializations and training
Piotr Sokol and Il Memming Park · 2020
Later among the works it cites.
The neuroanatomical ultrastructure and function of a biological ring attractor
Daniel B Turner-Evans, Kristopher T Jensen, Saba Ali, et al · 2020
Later among the works it cites.
Lipschitz recurrent neural networks
N. Benjamin Erichson, Omri Azencot, Alejandro Queiruga, Liam Hodgkinson, and Michael W Mahoney · 2021
Later among the works it cites.
Gated recurrent units viewed through the lens of continuous time dynamical systems
Ian D Jordan, Piotr Aleksander Sokol, and Il Memming Park · 2021
Later among the works it cites.
UnICORNN: A recurrent model for learning very long time dependencies
T Konstantin Rusch and Siddhartha Mishra · 2021
Later among the works it cites.
Computational roles of intrinsic synaptic dynamics
Genki Shimizu, Kensuke Yoshida, Haruo Kasai, and Taro Toyoizumi · 2021
Later among the works it cites.
On the origin of implicit regularization in stochastic gradient descent
Samuel L Smith, Benoit Dherin, David G T Barrett, and Soham De · 2021
Later among the works it cites.
Event-based backpropagation can compute exact gradients for spiking neural networks
Timo C. Wunderlich and Christian Pehle · 2021
Later among the works it cites.
Metastable dynamics of neural circuits and networks
Braden A W Brinkman, Han Yan, Arianna Maffei, et al · 2022
Later among the works it cites.
Learning to represent continuous variables in heterogeneous neural networks
Ran Darshan and Alexander Rivkind · 2022
Later among the works it cites.
Unsupervised learning for robust working memory
Jintao Gu and Sukbin Lim · 2022
Later among the works it cites.
Attractor and integrator networks in the brain
Mikail Khona and Ila R Fiete · 2022
Later among the works it cites.
On the difficulty of learning chaotic dynamics with RNNs
Jonas M Mikhaeil, Zahra Monfared, and Daniel Durstewitz · 2022
Later among the works it cites.
Accurate angular integration with only a handful of neurons
Marcella Noorman, Brad K Hulse, Vivek Jayaraman, Sandro Romani, and Ann M Hermundstad · 2022
Later among the works it cites.
On Lyapunov exponents for RNNs: Understanding information propagation using dynamical systems tools
Ryan Vogt, Maximilian Puelma Touzel, Eli Shlizerman, and Guillaume Lajoie · 2022
Later among the works it cites.
Brain rhythms have come of age
György Buzsáki and Mihály Vöröslakos · 2023
Closest in time.
An oscillatory mechanism for multi-level storage in short-term memory
Kathleen P Champion, Olivia Gozel, Benjamin S Lankow, G Bard Ermentrout, and Mark S Goldman · 2023
Closest in time.
Lyapunov spectra of chaotic recurrent neural networks
Rainer Engelken, Fred Wolf, and L F Abbott · 2023
Closest in time.
Resurrecting recurrent neural networks for long sequences
Antonio Orvieto, Samuel L Smith, Albert Gu, et al · 2023
Closest in time.
The study of plasticity has always been about gradients
Blake Aaron Richards and Konrad Paul Kording · 2023
Closest in time.
Geometry of learning and representation in neural networks
Piotr Sokół · 2023
Closest in time.