Fetching the paper…
Reading the bibliography…
We examine the efficiency of Recurrent Neural Networks in forecasting the spatiotemporal dynamics of high dimensional and reduced order complex systems using Reservoir Computing (RC) and Backpropagation through time (BPTT) for gated network architectures.
Machine-learning ocean dynamics from lagrangian drifter trajectories
Aksamit, N.O., Sapsis, T.P., Haller, G., 2019 · 1909
Earlier work this paper cites.
Mastering atari, go, chess and shogi by planning with a learned model
Schrittwieser, J., Antonoglou, I., Hubert, T., Simonyan, K., Sifre, L., Schmitt, S., Guez, A., Lockhart, E., Hassabis, D., Graepel, T., et al., 2019 · 1911
Earlier work this paper cites.
Hamiltonian systems and transformation in hilbert space
Koopman, B.O., 1931 · 1931
Earlier work this paper cites.
The numerical solution of variational problems
Dreyfus, S., 1962 · 1962
Earlier work this paper cites.
Taylor expansion of the accumulated rounding error
Linnainmaa, S., 1976 · 1976
Earlier work this paper cites.
Nonlinear analysis of hydrodynamic instability in laminar flames — I. Derivation of basic equations
Sivashinsky, G.I., 1977 · 1977
Earlier work this paper cites.
Solutions of Ill-posed problems
Tikhonov, A.N., Arsenin, V.Y., 1977 · 1977
Earlier work this paper cites.
Diffusion-Induced Chaos in Reaction Systems
Kuramoto, Y., 1978 · 1978
Earlier work this paper cites.
Chaotic behavior of multidimensional difference equations, in: Peitgen, H.O., Walther, H.O. (Eds.), Functional Differential Equations and Approximation of Fixed Points, Springer Berlin Heidelberg, Berlin, Heidelberg. pp. 204–227
Kaplan, J.L., Yorke, J.A., 1979 · 1979
Earlier work this paper cites.
Detecting strange attractors in turbulence, in: Rand, D., Young, L.S. (Eds.), Dynamical Systems and Turbulence, Warwick 1980, Springer Berlin Heidelberg, Berlin, Heidelberg. pp. 366–381
Takens, F., 1981 · 1980
Earlier work this paper cites.
Macroscopic modelling of turbulent flows, proceedings of a workshop held at inria, sophia-antipolis, france, 1984
Manneville, P., 1984 · 1984
Earlier work this paper cites.
Measurement of lyapunov spectrum from a chaotic time series
Sano, M., Sawada, Y., 1985 · 1985
Earlier work this paper cites.
Determining lyapunov exponents from a time series
Wolf, A., B. Swift, J., Swinney, H., A. Vastano, J., 1985 · 1985
Earlier work this paper cites.
Learning Representations by Back-propagating Errors
Rumelhart, D.E., Hinton, G.E., Williams, R.J., 1986 · 1986
Earlier work this paper cites.
Nonlinear signal processing using neural networks: Prediction and system modelling
Lapedes, A., Farber, R., 1987 · 1987
Earlier work this paper cites.
Generalization of backpropagation with application to a recurrent gas market model
Werbos, P.J., 1988 · 1988
Earlier work this paper cites.
Finding structure in time
Elman, J.L., 1990 · 1990
Earlier work this paper cites.
Backpropagation through time: what it does and how to do it
Werbos, P.J., 1990 · 1990
Earlier work this paper cites.
Embedology
Sauer, T., Yorke, J.A., Casdagli, M., 1991 · 1991
Earlier work this paper cites.
Learning long-term dependencies with gradient descent is difficult
Bengio, Y., Simard, P., Frasconi, P., 1994 · 1994
Earlier work this paper cites.
Predicting chaotic time series with wavelet networks
Cao, L., Hong, Y., Fang, H., He, G., 1995 · 1995
Earlier work this paper cites.
Predictability: a problem partly solved, in: Seminar on Predictability, 4-8 September 1995, ECMWF. ECMWF, Shinfield Park, Reading. pp. 1–18
Lorenz, E., 1995 · 1995
Earlier work this paper cites.
On the computational power of neural nets
Siegelmann, H., Sontag, E., 1995 · 1995
Earlier work this paper cites.
The topological invariance of Lyapunov exponents in embedded dynamics
Dechert, W.D., Gençay, R., 1996 · 1996
Earlier work this paper cites.
Mpi: a standard message passing interface
Walker, D.W., Dongarra, J.J., 1996 · 1996
Earlier work this paper cites.
Unsteady fluid mechanics applications of neural networks
Faller, W.E., Schreck, S.J., 1997 · 1997
Earlier work this paper cites.
On some properties of invariant sets of two-dimensional noninvertible maps
Frouzakis, C.E., Gardini, L., Kevrekidis, I.G., Millerioux, G., Mira, C., 1997 · 1997
Earlier work this paper cites.
Long short-term memory
Hochreiter, S., Schmidhuber, J., 1997 · 1997
Earlier work this paper cites.
Nonlinear Time Series Analysis
Kantz, H., Schreiber, T., 1997 · 1997
Earlier work this paper cites.
Noninvertibility and resonance in discrete-time neural networks for time-series processing
Gicquel, N., Anderson, J., Kevrekidis, I., 1998 · 1998
Earlier work this paper cites.
The vanishing gradient problem during learning recurrent neural nets and problem solutions
Hochreiter, S., 1998 · 1998
Earlier work this paper cites.
Prediction of spatiotemporal time series based on reconstructed local states
Parlitz, U., Merkwirth, C., 2000 · 2000
Cited alongside, same era.
Real-time computing without stable states: A new framework for neural computation based on perturbations
Maass, W., Natschläger, T., Markram, H., 2002 · 2002
Cited alongside, same era.
Chaos in Dynamical Systems
Ott, E., 2002 · 2002
Cited alongside, same era.
Harnessing nonlinearity: Predicting chaotic systems and saving energy in wireless communication
Jaeger, H., Haas, H., 2004 · 2004
Cited alongside, same era.
Weather forecasting with ensemble methods
Gneiting, T., Raftery, A.E., 2005 · 2005
Cited alongside, same era.
Fourth-order time-stepping for stiff pdes
Kassam, A., Trefethen, L., 2005 · 2005
Cited alongside, same era.
A theoretically grounded application of dropout in recurrent neural networks, in: Lee, D.D., Sugiyama, M., Luxburg, U.V., Guyon, I., Garnett, R. (Eds.), Advances in Neural Information Processing Systems 29. Curran Associates, Inc., pp. 1019–1027
Gal, Y., Ghahramani, Z., 2016 · 2016
Later among the works it cites.
Deep Learning
Goodfellow, I., Bengio, Y., Courville, A., 2016 · 2016
Later among the works it cites.
Lstm: A search space odyssey
Greff, K., Srivastava, R.K., Koutník, J., Steunebrink, B.R., Schmidhuber, J., 2016 · 2016
Later among the works it cites.
Deep residual learning for image recognition
He, K., Zhang, X., Ren, S., Sun, J., 2016 · 2016
Later among the works it cites.
Mastering the game of go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C.J., Guez, A., Sifre, L., Van Den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al., 2016 · 2016
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Recurrent neural networks are universal approximators, in: Proceedings of the 16th International Conference on Artificial Neural Networks - Volume Part I, Springer-Verlag, Berlin, Heidelberg. pp. 632–640
Schäfer, A.M., Zimmermann, H.G., 2006 · 2006
Cited alongside, same era.
Mpi for python: Performance improvements and mpi-2 extensions
Dalcín, L., Paz, R., Storti, M., D’Elía, J., 2008 · 2008
Cited alongside, same era.
Reservoir computing approaches to recurrent neural network training
Lukoševičius, M., Jaeger, H., 2009 · 2009
Cited alongside, same era.
Linear Regression Analysis
Yan, X., Su, X.G., 2009 · 2009
Cited alongside, same era.
Understanding the difficulty of training deep feedforward neural networks, in: Proceedings of the thirteenth international conference on artificial intelligence and statistics, pp. 249–256
Glorot, X., Bengio, Y., 2010 · 2010
Cited alongside, same era.
Parallel distributed computing using python
Dalcin, L.D., Paz, R.R., Kler, P.A., Cosimo, A., 2011 · 2011
Cited alongside, same era.
Brain-inspired photonic signal processor for generating periodic patterns and emulating chaotic systems
Antonik, P., Haelterman, M., Massar, S., 2017 · 2017
Later among the works it cites.
An overview and comparative analysis of recurrent neural networks for short term load forecasting
Bianchi, F.M., Maiorino, E., Kampffmeyer, M.C., Rizzi, A., Jenssen, R., 2017 · 2017
Later among the works it cites.
Dermatologist-level classification of skin cancer with deep neural networks
Esteva, A., Kuprel, B., Novoa, R.A., Ko, J., Swetter, S.M., Blau, H.M., Thrun, S., 2017 · 2017
Later among the works it cites.
Neuroscience-inspired artificial intelligence
Hassabis, D., Kumaran, D., Summerfield, C., Botvinick, M., 2017 · 2017
Later among the works it cites.
Tunable efficient unitary neural networks (EUNN) and their application to rnns, in: ICML, PMLR. pp. 1733–1741
Jing, L., Shen, Y., Dubcek, T., Peurifoy, J., Skirlo, S.A., LeCun, Y., Tegmark, M., Soljacic, M., 2017 · 2017
Later among the works it cites.
Zoneout: Regularizing rnns by randomly preserving hidden activations, in: 5th International Conference on Learning Representations, ICLR 2017, Toulon, France, April 24-26, 2017, Conference Track Proceedings
Krueger, D., Maharaj, T., Kramár, J., Pezeshki, M., Ballas, N., Ke, N.R., Goyal, A., Bengio, Y., Courville, A.C., Pal, C.J., 2017 · 2017
Later among the works it cites.
Time-series extreme event forecasting with neural networks at uber
Laptev, N., Yosinski, J., Li, L.E., Smyl, S., 2017 · 2017
Later among the works it cites.
High-speed photonic reservoir computing using a time-delay-based architecture: Million words per second classification
Larger, L., Baylón-Fuentes, A., Martinenghi, R., Udaltsov, V.S., Chembo, Y.K., Jacquot, M., 2017 · 2017
Later among the works it cites.
Automatic differentiation in pytorch
Paszke, A., Gross, S., Chintala, S., Chanan, G., Yang, E., DeVito, Z., Lin, Z., Desmaison, A., Antiga, L., Lerer, A., 2017 · 2017
Later among the works it cites.
Using machine learning to replicate chaotic attractors and calculate lyapunov exponents from data
Pathak, J., Lu, Z., Hunt, B.R., Girvan, M., Ott, E., 2017 · 2017
Later among the works it cites.
Data-driven forecasting of high-dimensional chaotic systems with long short-term memory networks
Vlachas, P.R., Byeon, W., Wan, Z.Y., Sapsis, T.P., Koumoutsakos, P., 2018 · 2017
Later among the works it cites.
Echo state networks are universal
Grigoryeva, L., Ortega, J.P., 2018 · 2018
Later among the works it cites.
Ha, D., Schmidhuber, J., 2018 · 2018
Later among the works it cites.
Exascale deep learning for climate analytics, in: SC18: International Conference for High Performance Computing, Networking, Storage and Analysis, IEEE. pp. 649–660
Kurth, T., Treichler, S., Romero, J., Mudigonda, M., Luehr, N., Phillips, E., Mahesh, A., Matheson, M., Deslippe, J., Fatica, M., et al., 2018 · 2018
Later among the works it cites.
Attractor reconstruction by machine learning
Lu, Z., Hunt, B.R., Ott, E., 2018 · 2018
Later among the works it cites.
Deep learning for universal linear embeddings of nonlinear dynamics
Lusch, B., Kutz, J.N., Brunton, S.L., 2018 · 2018
Later among the works it cites.
Deep convolutional neural networks for chaos identification in signal processing, in: 2018 26th European Signal Processing Conference (EUSIPCO), IEEE. pp. 1467–1471
Makarenko, A.V., 2018 · 2018
Later among the works it cites.
The limits and potentials of deep learning for robotics
Sünderhauf, N., Brock, O., Scheirer, W., Hadsell, R., Fox, D., Leitner, J., Upcroft, B., Abbeel, P., Burgard, W., Milford, M., et al., 2018 · 2018
Later among the works it cites.
Machine learning the kinematics of spherical particles in fluid flows
Wan, Z.Y., Sapsis, T.P., 2018 · 2018
Later among the works it cites.
Data-assisted reduced-order modeling of extreme events in complex dynamical systems
Wan, Z.Y., Vlachas, P., Koumoutsakos, P., Sapsis, T., 2018 · 2018
Later among the works it cites.
Reservoir computing universality with stochastic inputs
Gonon, L., Ortega, J.P., 2019 · 2019
Closest in time.
Model-free prediction of spatiotemporal dynamical systems with recurrent neural networks: Role of network spectral radius
Jiang, J., Lai, Y.C., 2019 · 2019
Closest in time.
Machine learning with observers predicts complex spatiotemporal behavior
Neofotistos, G., Mattheakis, M., Barmparis, G.D., Hizanidis, J., Tsironis, G.P., Kaxiras, E., 2019 · 2019
Closest in time.
Pathak, J., Wikner, A., Fussell, R., Chandra, S., Hunt, B.R., Girvan, M., Ott, E., 2018b · 2019
Closest in time.
Can machines learn to predict weather? using deep learning to predict gridded 500-hpa geopotential height from historical weather data
Weyn, J.A., Durran, D.R., Caruana, R., 2019 · 2019
Closest in time.
Machine learning for fluid mechanics
Brunton, S.L., Noack, B.R., Koumoutsakos, P., 2020 · 2020
Closest in time.