Fetching the paper…
Reading the bibliography…
We address the problem of denoising data from a Gaussian mixture using a two-layer non-linear autoencoder with tied weights and a skip connection.
The approximation of one matrix by another of lower rank
Carl Eckart and G. Marion Young · 1936
Earlier work this paper cites.
Towards a mean field theory for spin glasses
Giorgio Parisi · 1979
Earlier work this paper cites.
Order parameter for spin glasses
Giorgio Parisi · 1983
Earlier work this paper cites.
Auto-association by multilayer perceptrons and singular value decomposition
Hervé Bourlard and Yves Kamp · 1988
Earlier work this paper cites.
Optimal storage properties of neural network models
Elizabeth Gardner and Bernard Derrida · 1988
Earlier work this paper cites.
Neural networks and principal component analysis: Learning from examples without local minima
Pierre Baldi and Kurt Hornik · 1989
Earlier work this paper cites.
Generalization performance of bayes optimal classification algorithm for learning a perceptron
Manfred Opper and David Haussler · 1991
Earlier work this paper cites.
Gradient-based learning applied to document recognition
Yann LeCun, Léon Bottou, Yoshua Bengio, and Patrick Haffner · 1998
Earlier work this paper cites.
Statistical mechanics of support vector networks
Rainer Dietrich, Manfred Opper, and Haim Sompolinsky · 1999
Earlier work this paper cites.
Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion
Pascal Vincent, H. Larochelle, Isabelle Lajoie, Yoshua Bengio, and Pierre-Antoine Manzagol · 2010
Earlier work this paper cites.
Tweedie’s formula and selection bias
Bradley Efron · 2011
Earlier work this paper cites.
Adam: A method for stochastic optimization
Diederik P. Kingma and Jimmy Ba · 2014
Earlier work this paper cites.
Statistical physics of inference: thresholds and algorithms
Lenka Zdeborová and Florent Krzakala · 2015
Earlier work this paper cites.
U-net: Convolutional networks for biomedical image segmentation
Olaf Ronneberger, Philipp Fischer, and Thomas Brox · 2015
Earlier work this paper cites.
Image restoration using convolutional auto-encoders with symmetric skip connections
Xiao-Jiao Mao, Chunhua Shen, and Yubin Yang · 2016
Earlier work this paper cites.
Accurate image super-resolution using very deep convolutional networks
Jiwon Kim, Jung Kwon Lee, and Kyoung Mu Lee · 2016
Earlier work this paper cites.
Deeply-recursive convolutional network for image super-resolution
Jiwon Kim, Jung Kwon Lee, and Kyoung Mu Lee · 2016
Cited alongside, same era.
Fashion-mnist: a novel image dataset for benchmarking machine learning algorithms
Han Xiao, Kashif Rasul, and Roland Vollgraf · 2017
Cited alongside, same era.
Optimal errors and phase transitions in high-dimensional generalized linear models
Jean Barbier, Florent Krzakala, Nicolas Macris, Léo Miolane, and Lenka Zdeborová · 2017
Cited alongside, same era.
Image super-resolution using dense skip connections
Tong Tong, Gen Li, Xiejie Liu, and Qinquan Gao · 2017
Cited alongside, same era.
Learning dynamics of linear denoising autoencoders
Arnu Pretorius, Steve Kroon, and Herman Kamper · 2018
Cited alongside, same era.
The committee machine: computational to statistical gaps in learning a two-layers neural network
Generalization error in high-dimensional perceptrons: Approaching bayes error with convex optimization
Benjamin Aubin, Florent Krzakala, Yue M. Lu, and Lenka Zdeborová · 2020
Later among the works it cites.
Spectrum dependent learning curves in kernel regression and wide neural networks
Blake Bordelon, Abdulkadir Canatar, and Cengiz Pehlevan · 2020
Later among the works it cites.
Generalisation error in learning with random features and the hidden manifold model
Federica Gerace, Bruno Loureiro, Florent Krzakala, Marc Mézard, and Lenka Zdeborová · 2020
Later among the works it cites.
The gaussian equivalence of generative models for learning with shallow neural networks
Sebastian Goldt, Bruno Loureiro, Galen Reeves, Florent Krzakala, Marc Mézard, and Lenka Zdeborová · 2020
Later among the works it cites.
Universality laws for high-dimensional learning with random features
Hong Hu and Yue M. Lu · 2020
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Benjamin Aubin, Antoine Maillard, Jean Barbier, Florent Krzakala, Nicolas Macris, and Lenka Zdeborová · 2018
Cited alongside, same era.
Precise error analysis of regularized m m -estimators in high dimensions
Christos Thrampoulidis, Ehsan Abbasi, and Babak Hassibi · 2018
Cited alongside, same era.
Loss landscapes of regularized linear autoencoders
Daniel Kunin, Jonathan M. Bloom, Aleksandrina Goeva, and Cotton Seed · 2019
Cited alongside, same era.
Implicit regularization of discrete gradient dynamics in deep linear neural networks
Gauthier Gidel, Francis R. Bach, and Simon Lacoste-Julien · 2019
Cited alongside, same era.
Overparameterized neural networks implement associative memory
Adityanarayanan Radhakrishnan, Mikhail Belkin, and Caroline Uhler · 2019
Cited alongside, same era.
On the dynamics of gradient descent for autoencoders
Thanh Van Nguyen, Raymond K. W. Wong, and Chinmay Hegde · 2019
Cited alongside, same era.
Benefits of jointly training autoencoders: An improved neural tangent kernel analysis
Thanh Van Nguyen, Raymond K. W. Wong, and Chinmay Hegde · 2019
Cited alongside, same era.
Score-based generative modeling through stochastic differential equations
Yang Song, Jascha Narain Sohl-Dickstein, Diederik P. Kingma, Abhishek Kumar, Stefano Ermon, and Ben Poole · 2021
Later among the works it cites.
Analysis of feature learning in weight-tied autoencoders via the mean field lens
Phan-Minh Nguyen · 2021
Later among the works it cites.
A mechanism for producing aligned latent spaces with autoencoders
Saachi Jain, Adityanarayanan Radhakrishnan, and Caroline Uhler · 2021
Later among the works it cites.
Learning curves of generic features maps for realistic datasets with a teacher-student model
Bruno Loureiro, Cédric Gerbelot, Hugo Cui, Sebastian Goldt, Florent Krzakala, Marc Mézard, and Lenka Zdeborová · 2021
Later among the works it cites.
Learning gaussian mixtures with generalised linear models: Precise asymptotics in high-dimensions
Bruno Loureiro, Gabriele Sicuro, Cédric Gerbelot, Alessandro Pacco, Florent Krzakala, and Lenka Zdeborová · 2021
Later among the works it cites.
The dynamics of representation learning in shallow, non-linear autoencoders
Maria Refinetti and Sebastian Goldt · 2022
Later among the works it cites.
Fundamental limits of two-layer autoencoders, and achieving them with gradient methods
A. E. Shevchenko, Kevin Kögler, Hamed Hassani, and Marco Mondelli · 2022
Later among the works it cites.
Error rates for kernel classification under source and capacity conditions
Hugo Cui, Bruno Loureiro, Florent Krzakala, and Lenka Zdeborová · 2022
Later among the works it cites.
Contrasting random and learned features in deep bayesian linear regression
Jacob A. Zavatone-Veth, William Tong, and Cengiz Pehlevan · 2022
Later among the works it cites.
Universality of empirical risk minimization
Andrea Montanari and Basil N Saeed · 2022
Later among the works it cites.
Optimal learning of deep random networks of extensive-width
Hugo Cui, Florent Krzakala, and Lenka Zdeborová · 2023
Closest in time.