Fetching the paper…
Reading the bibliography…
We consider the well-studied problem of learning a linear combination of $k$ ReLU activations with respect to a Gaussian distribution on inputs in $d$ dimensions.
Beating the perils of non-convexity: Guaranteed training of neural networks using tensor methods
Majid Janzamin, Hanie Sedghi, and Anima Anandkumar · 2015
Earlier work this paper cites.
Polynomial-time tensor decompositions with sum-of-squares
Tengyu Ma, Jonathan Shi, and David Steurer · 2016
Earlier work this paper cites.
Provable tensor methods for learning mixtures of generalized linear models
Hanie Sedghi, Majid Janzamin, and Anima Anandkumar · 2016
Earlier work this paper cites.
L1-regularized neural networks are improperly learnable in polynomial time
Yuchen Zhang, Jason D Lee, and Michael I Jordan · 2016
Earlier work this paper cites.
Sgd learns the conjugate kernel class of the network
Amit Daniely · 2017
Earlier work this paper cites.
Reliably learning the relu in polynomial time
Surbhi Goel, Varun Kanade, Adam Klivans, and Justin Thaler · 2017
Earlier work this paper cites.
Convergence analysis of two-layer neural networks with relu activation
Yuanzhi Li and Yang Yuan · 2017
Earlier work this paper cites.
Learning relus via gradient descent
Mahdi Soltanolkotabi · 2017
Earlier work this paper cites.
Failures of gradient-based deep learning
Shai Shalev-Shwartz, Ohad Shamir, and Shaked Shammah · 2017
Earlier work this paper cites.
Electron-proton dynamics in deep learning
Qiuyi Zhang, Rina Panigrahy, and Sushant Sachdeva · 2017
Earlier work this paper cites.
Recovery guarantees for one-hidden-layer neural networks
Kai Zhong, Zhao Song, Prateek Jain, Peter L Bartlett, and Inderjit S Dhillon · 2017
Earlier work this paper cites.
Learning two-layer neural networks with symmetric inputs
Rong Ge, Rohith Kuditipudi, Zhize Li, and Xiang Wang · 2018
Cited alongside, same era.
Learning one convolutional layer with overlapping patches
Surbhi Goel, Adam R. Klivans, and Raghu Meka · 2018
Cited alongside, same era.
Learning one-hidden-layer neural networks with landscape design
Rong Ge, Jason D Lee, and Tengyu Ma · 2018
Cited alongside, same era.
Learning one-hidden-layer neural networks under general input distributions
Weihao Gao, Ashok Vardhan Makkuva, Sewoong Oh, and Pramod Viswanath · 2018
Cited alongside, same era.
The computational complexity of training relu (s)
Pasin Manurangsi and Daniel Reichman · 2018
Cited alongside, same era.
Learning polynomials of few relevant dimensions
Sitan Chen and Raghu Meka · 2020
Later among the works it cites.
Approximation schemes for relu regression
Ilias Diakonikolas, Surbhi Goel, Sushrut Karmalkar, Adam R Klivans, and Mahdi Soltanolkotabi · 2020
Later among the works it cites.
Small covers for near-zero sets of polynomials and learning latent variable models
Ilias Diakonikolas and Daniel M Kane · 2020
Later among the works it cites.
Algorithms and sq lower bounds for pac learning one-hidden-layer relu networks
Ilias Diakonikolas, Daniel M Kane, Vasilis Kontonis, and Nikos Zarifis · 2020
Later among the works it cites.
Hardness of learning neural networks with natural weights
Amit Daniely and Gal Vardi · 2020
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Ohad Shamir · 2018
Cited alongside, same era.
Learning and generalization in overparameterized neural networks, going beyond two layers
Zeyuan Allen-Zhu, Yuanzhi Li, and Yingyu Liang · 2019
Cited alongside, same era.
Learning two layer rectified neural networks in polynomial time
Ainesh Bakshi, Rajesh Jayaram, and David P Woodruff · 2019
Cited alongside, same era.
Learning neural networks with two nonlinear layers in polynomial time
Surbhi Goel and Adam R Klivans · 2019
Cited alongside, same era.
Gradient descent for one-hidden-layer neural networks: Polynomial convergence and sq lower bounds
Santosh Vempala and John Wilmes · 2019
Cited alongside, same era.
Learning one-hidden-layer relu networks via gradient descent
Xiao Zhang, Yaodong Yu, Lingxiao Wang, and Quanquan Gu · 2019
Cited alongside, same era.
Superpolynomial lower bounds for learning one-layer neural networks using gradient descent
Surbhi Goel, Aravind Gollakota, Zhihan Jin, Sushrut Karmalkar, and Adam Klivans · 2020
Later among the works it cites.
Learning over-parametrized two-layer neural networks beyond ntk
Yuanzhi Li, Tengyu Ma, and Hongyang R. Zhang · 2020
Later among the works it cites.
Efficiently learning any one hidden layer relu network from queries
Sitan Chen, Adam R Klivans, and Raghu Meka · 2021
Later among the works it cites.
Learning deep relu networks is fixed-parameter tractable
Sitan Chen, Adam R Klivans, and Raghu Meka · 2022
Later among the works it cites.
Learning polynomial transformations
Sitan Chen, Jerry Li, Yuanzhi Li, and Anru R Zhang · 2022
Later among the works it cites.