Fetching the paper…
Reading the bibliography…
Standard infinite-width limits of neural networks sacrifice the ability for intermediate layers to learn representations from data.
BAYESIAN LEARNING FOR NEURAL NETWORKS
Radford M Neal · 1995
Earlier work this paper cites.
Gradient-based learning applied to document recognition
Yann LeCun, Léon Bottou, Yoshua Bengio, and Patrick Haffner · 1998
Earlier work this paper cites.
Introduction to gaussian processes
David John Cameron MacKay · 1998
Earlier work this paper cites.
Kernel methods for deep learning
Youngmin Cho and Lawrence K Saul · 2009
Earlier work this paper cites.
Imagenet: A large-scale hierarchical image database
Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li, and Li Fei-Fei · 2009
Earlier work this paper cites.
Learning multiple layers of features from tiny images
Alex Krizhevsky and Geoffrey Hinton · 2009
Earlier work this paper cites.
Inter-domain gaussian processes for sparse inference using inducing features
Miguel Lázaro-Gredilla and Anibal Figueiras-Vidal · 2009
Earlier work this paper cites.
Representation learning: A review and new perspectives
Yoshua Bengio, Aaron Courville, and Pascal Vincent · 2013
Earlier work this paper cites.
Convolutional kernel networks
Julien Mairal, Piotr Koniusz, Zaid Harchaoui, and Cordelia Schmid · 2014
Earlier work this paper cites.
Deep learning
Yann LeCun, Yoshua Bengio, and Geoffrey Hinton · 2015
Earlier work this paper cites.
Manifold gaussian processes for regression
Roberto Calandra, Jan Peters, Carl Edward Rasmussen, and Marc Peter Deisenroth · 2016
Earlier work this paper cites.
Deep Residual Learning for Image Recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun · 2016
Earlier work this paper cites.
End-to-end kernel learning with supervised convolutional kernel networks
Julien Mairal · 2016
Earlier work this paper cites.
John Bradshaw, Alexander G de G Matthews, and Zoubin Ghahramani · 2017
Earlier work this paper cites.
Variational fourier features for gaussian processes
James Hensman, Nicolas Durrande, Arno Solin, et al · 2017
Earlier work this paper cites.
Deep neural networks as gaussian processes
Jaehoon Lee, Yasaman Bahri, Roman Novak, Samuel S Schoenholz, Jeffrey Pennington, and Jascha Sohl-Dickstein · 2017
Earlier work this paper cites.
Deep restricted kernel machines using conjugate feature duality
Johan AK Suykens · 2017
Earlier work this paper cites.
Convolutional gaussian processes, 2017
Mark van der Wilk, Carl Edward Rasmussen, and James Hensman · 2017
Earlier work this paper cites.
Deep convolutional gaussian processes, 2018
Kenneth Blomqvist, Samuel Kaski, and Markus Heinonen · 2018
Earlier work this paper cites.
Deep convolutional networks as shallow gaussian processes
Adrià Garriga-Alonso, Carl Edward Rasmussen, and Laurence Aitchison · 2018
Earlier work this paper cites.
Neural tangent kernel: Convergence and generalization in neural networks
Arthur Jacot, Clément Hongler, and Franck Gabriel · 2018
Cited alongside, same era.
Gaussian process behaviour in wide deep neural networks
Alexander G de G Matthews, Mark Rowland, Jiri Hron, Richard E Turner, and Zoubin Ghahramani · 2018
Cited alongside, same era.
Bayesian deep convolutional networks with many channels are gaussian processes
Roman Novak, Lechao Xiao, Jaehoon Lee, Yasaman Bahri, Greg Yang, Jiri Hron, Daniel A Abolafia, Jeffrey Pennington, and Jascha Sohl-Dickstein · 2018
Cited alongside, same era.
Natural gradients in practice: Non-conjugate variational inference in gaussian process models
Hugh Salimbeni, Stefanos Eleftheriadis, and James Hensman · 2018
Cited alongside, same era.
Finite size corrections for neural network gaussian processes
Joseph M Antognini · 2019
Cited alongside, same era.
Sparse orthogonal variational inference for gaussian processes
Jiaxin Shi, Michalis Titsias, and Andriy Mnih · 2020
Later among the works it cites.
Non-gaussian processes and neural networks at finite widths
Sho Yaida · 2020
Later among the works it cites.
Deep kernel processes
Laurence Aitchison, Adam X. Yang, and Sebastian W. Ober · 2021
Later among the works it cites.
Deep neural networks as point estimates for deep gaussian processes
Vincent Dutordoir, James Hensman, Mark van der Wilk, Carl Henrik Ek, Zoubin Ghahramani, and Nicolas Durrande · 2021
Later among the works it cites.
Neural networks and quantum field theory
James Halverson, Anindita Maiti, and Keegan Stoner · 2021
Later among the works it cites.
A self consistent theory of gaussian processes captures feature learning effects in finite cnns
Gadi Naveh and Zohar Ringel · 2021
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
On exact computation with an infinitely wide neural net
Sanjeev Arora, Simon S Du, Wei Hu, Zhiyuan Li, Russ R Salakhutdinov, and Ruosong Wang · 2019
Cited alongside, same era.
A representer theorem for deep kernel learning
Bastian Bohn, Christian Rieger, and Michael Griebel · 2019
Cited alongside, same era.
Recurrent kernel networks
Dexiong Chen, Laurent Jacob, and Julien Mairal · 2019
Cited alongside, same era.
Asymptotics of wide networks from feynman diagrams
Ethan Dyer and Guy Gur-Ari · 2019
Cited alongside, same era.
Finite depth and width corrections to the neural tangent kernel
Boris Hanin and Mihai Nica · 2019
Cited alongside, same era.
Enhanced convolutional neural tangent kernels
Zhiyuan Li, Ruosong Wang, Dingli Yu, Simon S Du, Wei Hu, Ruslan Salakhutdinov, and Sanjeev Arora · 2019
Cited alongside, same era.
Pytorch: An imperative style, high-performance deep learning library
Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, Alban Desmaison, Andreas Kopf, Edward Yang, Zachary DeVito, Martin Raison, Alykhan Tejani, Sasank Chilamkurthy, Benoit Steiner, Lu Fang, Junjie Bai, and Soumith Chintala · 2019
Cited alongside, same era.
Later among the works it cites.
The promises and pitfalls of deep kernel learning
Sebastian W Ober, Carl E Rasmussen, and Mark van der Wilk · 2021
Later among the works it cites.
The limitations of large width in neural networks: A deep gaussian process perspective
Geoff Pleiss and John P Cunningham · 2021
Later among the works it cites.
The principles of deep learning theory
Daniel A Roberts, Sho Yaida, and Boris Hanin · 2021
Later among the works it cites.
Feature learning in infinite-width neural networks
Greg Yang and Edward J Hu · 2021
Later among the works it cites.
Exact marginal prior distributions of finite bayesian neural networks
Jacob Zavatone-Veth and Cengiz Pehlevan · 2021
Later among the works it cites.
Low-precision arithmetic for fast gaussian processes
Wesley J. Maddox, Andres Potapcynski, and Andrew Gordon Wilson · 2022
Later among the works it cites.
Efficient computation of deep nonlinear infinite-width neural networks that learn features
Greg Yang, Michael Santacroce, and Edward J Hu · 2022
Later among the works it cites.
Semi-supervised classification with graph convolutional kernel machines
Sonny Achten, Francesco Tonin, Panagiotis Patrinos, and Johan AK Suykens · 2023
Closest in time.
Kernel regression with infinite-width neural networks on millions of examples, 2023
Ben Adlam, Jaehoon Lee, Shreyas Padhy, Zachary Nado, and Jasper Snoek · 2023
Closest in time.
Separation of scales and a thermodynamic description of feature learning in some cnns
Inbar Seroussi, Gadi Naveh, and Zohar Ringel · 2023
Closest in time.
Deep kernel principal component analysis for multi-level feature learning
Francesco Tonin, Qinghua Tao, Panagiotis Patrinos, and Johan AK Suykens · 2023
Closest in time.
A theory of representation learning gives a deep generalisation of kernel methods
Adam X. Yang, Maxime Robeyns, Edward Milsom, Ben Anson, Nandi Schoots, and Laurence Aitchison · 2023
Closest in time.
Asymptotics of representation learning in finite bayesian neural networks
Jacob Zavatone-Veth, Abdulkadir Canatar, Ben Ruben, and Cengiz Pehlevan · 2023
Closest in time.