On the Empirical Neural Tangent Kernel of Standard Finite-Width Convolutional Neural Network Architectures

Gradient-based learning applied to document recognition

Yann LeCun, Léon Bottou, Yoshua Bengio, and Patrick Haffner · 1998

Earlier work this paper cites.

The effective rank: A measure of effective dimensionality

Olivier Roy and Martin Vetterli · 2007

Earlier work this paper cites.

Learning multiple layers of features from tiny images

Alex Krizhevsky, Geoffrey Hinton, et al · 2009

Earlier work this paper cites.

Imagenet classification with deep convolutional neural networks

Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton · 2012

Earlier work this paper cites.

One weird trick for parallelizing convolutional neural networks

Original

Alex Krizhevsky · 2014

Earlier work this paper cites.

Delving deep into rectifiers: Surpassing human-level performance on imagenet classification

Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun · 2015

Earlier work this paper cites.

ImageNet Large Scale Visual Recognition Challenge

Olga Russakovsky, Jia Deng, Hao Su, Jonathan Krause, Sanjeev Satheesh, Sean Ma, Zhiheng Huang, Andrej Karpathy, Aditya Khosla, Michael Bernstein, Alexander C. Berg, and Li Fei-Fei · 2015

Earlier work this paper cites.

Very deep convolutional networks for large-scale image recognition

Karen Simonyan and Andrew Zisserman · 2015

Earlier work this paper cites.

Deep residual learning for image recognition

Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun · 2016

Cited alongside, same era.

Wide residual networks

Original

Sergey Zagoruyko and Nikos Komodakis · 2016

Cited alongside, same era.

On the global convergence of gradient descent for over-parameterized models using optimal transport

Lenaic Chizat and Francis Bach · 2018

Cited alongside, same era.

Neural tangent kernel: Convergence and generalization in neural networks

Arthur Jacot, Franck Gabriel, and Clément Hongler · 2018

Cited alongside, same era.

On exact computation with an infinitely wide neural net

Sanjeev Arora, Simon S Du, Wei Hu, Zhiyuan Li, Russ R Salakhutdinov, and Ruosong Wang · 2019

Cited alongside, same era.

On lazy training in differentiable programming

Analysis of a two-layer neural network via displacement convexity

Original

Adel Javanmard, Marco Mondelli, and Andrea Montanari · 2019

Later among the works it cites.

Wide neural networks of any depth evolve as linear models under gradient descent

Jaehoon Lee, Lechao Xiao, Samuel Schoenholz, Yasaman Bahri, Roman Novak, Jascha Sohl-Dickstein, and Jeffrey Pennington · 2019

Later among the works it cites.

Mean-field theory of two-layers neural networks: dimension-free bounds and kernel limit

Song Mei, Theodor Misiakiewicz, and Andrea Montanari · 2019

Later among the works it cites.

Mean field limit of the learning dynamics of multilayer neural networks

Original

Phan-Minh Nguyen · 2019

Later among the works it cites.

Pytorch: An imperative style, high-performance deep learning library

Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, Alban Desmaison, Andreas Kopf, Edward Yang, Zachary DeVito, Martin Raison, Alykhan Tejani, Sasank Chilamkurthy, Benoit Steiner, Lu Fang, Junjie Bai, and Soumith Chintala · 2019