Fetching the paper…
Reading the bibliography…
Recurrent neural networks (RNNs) are powerful dynamical models, widely used in machine learning (ML) and neuroscience.
S.-I. Amari, Characteristics of random nets of analog neuron-like elements, IEEE Transactions on systems, man, and cybernetics , 643 (1972)
1972
Earlier work this paper cites.
P. C. Martin, E. Siggia, and H. Rose, Statistical dynamics of classical systems, Physical Review A 8
1973
Earlier work this paper cites.
H.-K. Janssen, On a lagrangean for classical field dynamics and renormalization group calculations of dynamical critical properties, Zeitschrift für Physik B Condensed Matter 23
1976
Earlier work this paper cites.
C. De Dominicis, Dynamics as a substitute for replicas in systems with quenched random impurities, Physical Review B 18
1978
Earlier work this paper cites.
H. Sompolinsky and A. Zippelius, Dynamic theory of the spin-glass phase, Physical Review Letters 47
1981
Earlier work this paper cites.
S. Geman and C.-R. Hwang, A chaos hypothesis for some large systems of random equations, Zeitschrift für Wahrscheinlichkeitstheorie und Verwandte Gebiete 60
1982
Earlier work this paper cites.
H. Sompolinsky and A. Zippelius, Relaxational dynamics of the edwards-anderson model and the mean-field theory of spin-glasses, Physical Review B 25
1982
Earlier work this paper cites.
J.-P. Eckmann and D. Ruelle, Ergodic theory of chaos and strange attractors, in The theory of chaotic attractors (Springer, 1985) pp. 273–312
1985
Earlier work this paper cites.
B. Derrida and Y. Pomeau, Random networks of automata: a simple annealed approximation, EPL (Europhysics Letters) 1
1986
Earlier work this paper cites.
H. Sompolinsky, A. Crisanti, and H.-J. Sommers, Chaos in random neural networks, Physical review letters 61
1988
Earlier work this paper cites.
K. Geist, U. Parlitz, and W. Lauterborn, Comparison of different methods for computing lyapunov exponents, Progress of theoretical physics 83
1990
Earlier work this paper cites.
L. Molgedey, J. Schuchhardt, and H. G. Schuster, Suppressing chaos in neural networks by noise, Physical review letters 69
1992
Earlier work this paper cites.
B. Cessac, Increase in complexity in random neural networks, Journal de Physique I 5
1995
Earlier work this paper cites.
The local chaos hypothesis employed by Cessac Cessac 1995 amounts to the same assumption
1995
Earlier work this paper cites.
H. S. Seung, How the brain keeps the eyes still, Proceedings of the National Academy of Sciences 93
1996
Earlier work this paper cites.
S. Hochreiter and J. Schmidhuber, Long short-term memory, Neural computation 9
1997
Earlier work this paper cites.
J. Feinberg and A. Zee, Non-hermitian random matrix theory: Method of hermitian reduction, Nuclear Physics B 504
1997
Earlier work this paper cites.
J. T. Chalker and B. Mehlig, Eigenvector statistics in non-hermitian random matrix ensembles, Physical review letters 81
1998
Earlier work this paper cites.
H. S. Seung, Continuous attractors and oculomotor control, Neural Networks 11
1998
Earlier work this paper cites.
H. S. Seung, D. D. Lee, B. Y. Reis, and D. W. Tank, Stability of the memory of eye position in a recurrent network of conductance-based model neurons, Neuron 26
2000
Earlier work this paper cites.
V. M. Eguíluz, M. Ospeck, Y. Choe, A. Hudspeth, and M. O. Magnasco, Essential nonlinearities in hearing, Physical review letters 84
2000
Earlier work this paper cites.
S. J. Mitchell and R. A. Silver, Shunting inhibition modulates neuronal gain during synaptic excitation, Neuron 38
2003
Earlier work this paper cites.
H. Jaeger and H. Haas, Harnessing nonlinearity: Predicting chaotic systems and saving energy in wireless communication, science 304
2004
Earlier work this paper cites.
Y. V. Fyodorov, Complexity of random energy landscapes, glass transition, and absolute value of the spectral determinant of random matrices, Physical review letters 92
2004
Earlier work this paper cites.
N. Bertschinger and T. Natschläger, Real-time computation at the edge of chaos in recurrent neural networks, Neural computation 16
2004
Cited alongside, same era.
T. P. Vogels, K. Rajan, and L. F. Abbott, Neural network dynamics, Annu. Rev. Neurosci. 28
2005
Cited alongside, same era.
C. K. Machens, R. Romo, and C. D. Brody, Flexible control of mutual inhibition: a neural model of two-interval discrimination, Science 307
2005
Cited alongside, same era.
R. Brette, Exact simulation of integrate-and-fire models with synaptic conductances, Neural Computation 18
2006
Cited alongside, same era.
D. Sussillo and L. F. Abbott, Generating coherent patterns of activity from chaotic neural networks, Neuron 63
2009
Cited alongside, same era.
C. C. Chow and M. A. Buice, Path integral methods for stochastic differential equations, The Journal of Mathematical Neuroscience (JMN) 5
2015
Later among the works it cites.
2016
Later among the works it cites.
R. Chaudhuri and I. Fiete, Computational principles of memory, Nature neuroscience 19
2016
Later among the works it cites.
K. Greff, R. K. Srivastava, J. Koutník, B. R. Steunebrink, and J. Schmidhuber, Lstm: A search space odyssey, IEEE transactions on neural networks and learning systems 28
2016
Later among the works it cites.
J. Pathak, B. Hunt, M. Girvan, Z. Lu, and E. Ott, Model-free prediction of large spatiotemporally chaotic systems from data: A reservoir computing approach, Physical review letters 120
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
R. Gütig and H. Sompolinsky, Time-warp–invariant neuronal processing, PLoS biology 7
2009
Cited alongside, same era.
M. S. Goldman, Memory without feedback in a neural network, Neuron 61
2009
Cited alongside, same era.
K. Rajan, L. Abbott, and H. Sompolinsky, Stimulus-dependent suppression of chaos in recurrent neural networks, Physical Review E 82
2010
Cited alongside, same era.
T. Mora and W. Bialek, Are biological systems poised at criticality?, Journal of Statistical Physics 144
2011
Cited alongside, same era.
T. Toyoizumi and L. Abbott, Beyond the edge of chaos: Amplification and temporal integration by recurrent networks in the chaotic regime, Physical Review E 84
2011
Cited alongside, same era.
W. Bialek, Biophysics: searching for principles (Princeton University Press, 2012)
2012
Cited alongside, same era.
J. Boedecker, O. Obst, J. T. Lizier, N. M. Mayer, and M. Asada, Information processing in echo state networks at the edge of chaos, Theory in Biosciences 131
2012
Cited alongside, same era.
2018
Later among the works it cites.
D. Martí, N. Brunel, and S. Ostojic, Correlations between synapses in pairs of neurons slow down dynamics in randomly connected neural networks, Physical Review E 97
2018
Later among the works it cites.
F. Mastrogiuseppe and S. Ostojic, Linking connectivity, dynamics, and computations in low-rank recurrent neural networks, Neuron 99
2018
Later among the works it cites.
J. Schuecker, S. Goedeke, and M. Helias, Optimal sequence memory in driven random networks, Physical Review X 8
2018
Later among the works it cites.
A. Crisanti and H. Sompolinsky, Path integral approach to random neural networks, Physical Review E 98
2018
Later among the works it cites.
2018
Later among the works it cites.
U. Pereira and N. Brunel, Attractor dynamics in networks with learning rules inferred from in vivo data, Neuron 99
2018
Later among the works it cites.
2019
Later among the works it cites.
N. Maheswaranathan, A. Williams, M. Golub, S. Ganguli, and D. Sussillo, Reverse engineering recurrent networks for sentiment classification reveals line attractor dynamics, in Advances in Neural Information Processing Systems (2019) pp. 15696–15705
2019
Later among the works it cites.
M. Farrell, S. Recanatesi, T. Moore, G. Lajoie, and E. Shea-Brown, Recurrent neural networks learn robust representations by dynamically balancing compression and expansion, bioRxiv , 564476 (2019)
2019
Later among the works it cites.
S. P. Muscinelli, W. Gerstner, and T. Schwalger, How single neuron properties shape chaotic dynamics and signal transmission in random neural networks, PLoS computational biology 15
2019
Later among the works it cites.
M. Beiran and S. Ostojic, Contrasting the effects of adaptation and synaptic filtering on the timescales of dynamics in recurrent networks, PLoS computational biology 15
2019
Later among the works it cites.
F. Roy, G. Biroli, G. Bunin, and C. Cammarota, Numerical implementation of dynamical mean field theory for disordered systems: application to the lotka–volterra model of ecosystems, Journal of Physics A: Mathematical and Theoretical 52
2019
Later among the works it cites.
P. R. Vlachas, J. Pathak, B. R. Hunt, T. P. Sapsis, M. Girvan, E. Ott, and P. Koumoutsakos, Backpropagation algorithms and reservoir computing in recurrent neural networks for the forecasting of complex spatiotemporal dynamics, Neural Networks (2020)
2020
Closest in time.
2020
Closest in time.
F. Schuessler, A. Dubreuil, F. Mastrogiuseppe, S. Ostojic, and O. Barak, Dynamics of random recurrent networks with correlated low-rank structure, Physical Review Research 2
2020
Closest in time.
T. Can, K. Krishnamurthy, and D. J. Schwab, Gating creates slow modes and controls phase-space complexity in GRUs and LSTMs, in Mathematical and Scientific Machine Learning (PMLR, 2020) pp. 476–511
2020
Closest in time.
The continuous-time gated RNN we study in this paper is most closely related to the Gated Recurrent Unit (GRU) architecture studied in Can et al. 2020
2020
Closest in time.
2020
Closest in time.