Fetching the paper…
Reading the bibliography…
Motivated by the paradigm of reservoir computing, we consider randomly initialized controlled ResNets defined as Euler-discretizations of neural controlled differential equations (Neural CDEs), a unified architecture which enconpasses both RNNs and ResNets.
A limit theorem for the norm of random matrices
Geman, S · 1980
Earlier work this paper cites.
Numerical Solution of Stochastic Differential Equations
Kloeden, P. and Platen, E · 1992
Earlier work this paper cites.
Differential equations driven by rough signals
Lyons, T. J · 1998
Earlier work this paper cites.
Shape fluctuations and random matrices
Johansson, K · 2000
Earlier work this paper cites.
On the distribution of the largest eigenvalue in principal components analysis
Johnstone, I. M · 2001
Earlier work this paper cites.
Euler scheme for a stochastic goursat problem
Huang, Y. and Tsai, C.-Y · 2004
Earlier work this paper cites.
Differential equations driven by rough paths
Lyons, T. J., Caruana, M., and Lévy, T · 2007
Earlier work this paper cites.
Random features for large-scale kernel machines
Rahimi, A. and Recht, B · 2007
Earlier work this paper cites.
An experimental unification of reservoir computing methods
Verstraeten, D., Schrauwen, B., d’Haene, M., and Stroobandt, D · 2007
Earlier work this paper cites.
Reservoir computing approaches to recurrent neural network training
Lukoševičius, M. and Jaeger, H · 2009
Earlier work this paper cites.
Large deviations of the maximum eigenvalue for wishart and gaussian random matrices
Majumdar, S. N. and Vergassola, M · 2009
Earlier work this paper cites.
Multidimensional Stochastic Processes as Rough Paths: Theory and Applications
Friz, P. K. and Victoir, N. B · 2010
Earlier work this paper cites.
Taylor expansion for the solution of a stochastic differential equation driven by fractional Brownian motions
Baudoin, F. and Zhang, X · 2012
Earlier work this paper cites.
Bayesian learning for neural networks , volume 118
Neal, R. M · 2012
Earlier work this paper cites.
A theory of regularity structures
Hairer, M · 2014
Earlier work this paper cites.
Exponential expressivity in deep neural networks through transient chaos, 2016
Poole, B., Lahiri, S., Raghu, M., Sohl-Dickstein, J., and Ganguli, S · 2016
Earlier work this paper cites.
Analysis I: Third Edition
Tao, T · 2016
Earlier work this paper cites.
Deep information propagation
Schoenholz, S. S., Gilmer, J., Ganguli, S., and Sohl-Dickstein, J · 2017
Cited alongside, same era.
Neural ordinary differential equations
Chen, R. T., Rubanova, Y., Bettencourt, J., and Duvenaud, D. K · 2018
Cited alongside, same era.
Deep convolutional networks as shallow gaussian processes
Garriga-Alonso, A., Rasmussen, C. E., and Aitchison, L · 2018
Cited alongside, same era.
Neural tangent kernel: Convergence and generalization in neural networks
Jacot, A., Gabriel, F., and Hongler, C · 2018
Cited alongside, same era.
Deep neural networks as gaussian processes
Lee, J., Sohl-dickstein, J., Pennington, J., Novak, R., Schoenholz, S., and Bahri, Y · 2018
Cited alongside, same era.
Tensor programs ii: Neural tangent kernel for any architecture
Yang, G · 2020
Later among the works it cites.
Policy analysis using synthetic controls in continuous-time
Bellot, A. and Van Der Schaar, M · 2021
Later among the works it cites.
Cass, T., Lyons, T., and Xu, X · 2021
Later among the works it cites.
Sk-tree: a systematic malware detection algorithm on streaming trees via the signature kernel
Cochrane, T., Foster, P., Chhabra, V., Lemercier, M., Lyons, T., and Salvi, C · 2021
Later among the works it cites.
Scaling properties of deep residual networks
Cohen, A.-S., Cont, R., Rossier, A., and Xu, R · 2021
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Matthews, A. G. d. G., Rowland, M., Hron, J., Turner, R. E., and Ghahramani, Z · 2018
Cited alongside, same era.
Bayesian deep convolutional networks with many channels are gaussian processes
Novak, R., Xiao, L., Lee, J., Bahri, Y., Yang, G., Hron, J., Abolafia, D. A., Pennington, J., and Sohl-Dickstein, J · 2018
Cited alongside, same era.
Deep signature transforms
Kidger, P., Bonnier, P., Perez Arribas, I., Salvi, C., and Lyons, T · 2019
Cited alongside, same era.
Kernels for sequentially ordered data
Király, F. J. and Oberhauser, H · 2019
Cited alongside, same era.
Recent advances in physical reservoir computing: A review
Tanaka, G., Yamane, T., Héroux, J. B., Nakane, R., Kanazawa, N., Takeda, S., Numata, H., Nakano, D., and Hirose, A · 2019
Cited alongside, same era.
Wide feedforward or recurrent neural networks of any architecture are gaussian processes
Yang, G · 2019
Cited alongside, same era.
The recurrent neural tangent kernel
Alemohammad, S., Wang, Z., Balestriero, R., and Baraniuk, R · 2020
Cited alongside, same era.
Fermanian, A., Marion, P., Vert, J.-P., and Biau, G · 2021
Later among the works it cites.
The future is log-gaussian: Resnets and their infinite-depth-and-width limit at initialization
Li, M., Nica, M., and Roy, D · 2021
Later among the works it cites.
Neural controlled differential equations for online prediction tasks
Morrill, J., Kidger, P., Yang, L., and Lyons, T · 2021
Later among the works it cites.
Applications of signature methods to market anomaly detection, 2022
Akyildirim, E., Gambara, M., Teichmann, J., and Zhou, S · 2022
Later among the works it cites.
Asymptotic analysis of deep residual networks
Cont, R., Rossier, A., and Xu, R · 2022
Later among the works it cites.
On the infinite-depth limit of finite-width neural networks
Hayou, S · 2022
Later among the works it cites.
On neural differential equations
Kidger, P · 2022
Later among the works it cites.
The neural covariance sde: Shaped infinite depth-and-width networks at initialization, 2022
Li, M. B., Nica, M., and Roy, D. M · 2022
Later among the works it cites.
Scaling resnets in the large-depth regime
Marion, P., Fermanian, A., Biau, G., and Vert, J.-P · 2022
Later among the works it cites.
Neural stochastic pdes: Resolution-invariant learning of continuous spatiotemporal dynamics
Salvi, C., Lemercier, M., and Gerasimovics, A · 2022
Later among the works it cites.
Multiscale sensor fusion and continuous control with neural cdes
Singh, S., Ramirez, F. M., Varley, J., Zeng, A., and Sindhwani, V · 2022
Later among the works it cites.
Width and depth limits commute in residual networks, 2023
Hayou, S. and Yang, G · 2023
Closest in time.