Fetching the paper…
Reading the bibliography…
Expressive efficiency refers to the relation between two architectures A and B, whereby any function realized by B could be replicated by A, but there exists functions realized by A, which cannot be replicated by B unless its size grows significantly larger.
Borel sets and circuit complexity
Michael Sipser · 1983
Earlier work this paper cites.
Circuits and Local Computation
Andrew Chi-Chih Yao · 1989
Earlier work this paper cites.
On the Power of Small-Depth Threshold Circuits
Johan Håstad and Mikael Goldmann · 1991
Earlier work this paper cites.
Threshold Circuits of Bounded Depth
András Hajnal, Wolfgang Maass, Pavel Pudlák, Mario Szegedy, and György Turán · 1993
Earlier work this paper cites.
A Bayesian Hierarchical Model for Learning Natural Scene Categories
Fei-Fei Li and Pietro Perona · 2005
Earlier work this paper cites.
Selecting Receptive Fields in Deep Networks
Adam Coates and Andrew Y Ng · 2011
Earlier work this paper cites.
An Analysis of Single-Layer Networks in Unsupervised Feature Learning
Adam Coates, Andrew Y Ng, and Honglak Lee · 2011
Earlier work this paper cites.
Tensor Spaces and Numerical Tensor Calculus , volume 42 of Springer Series in Computational Mathematics
Wolfgang Hackbusch · 2012
Earlier work this paper cites.
Beyond spatial pyramids - Receptive field learning for pooled image features
Yangqing Jia, Chang Huang, and Trevor Darrell · 2012
Earlier work this paper cites.
ImageNet Classification with Deep Convolutional Neural Networks
Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton · 2012
Earlier work this paper cites.
On the number of response regions of deep feed forward networks with piece-wise linear activations
Razvan Pascanu, Guido Montufar, and Yoshua Bengio · 2013
Earlier work this paper cites.
Discriminative Unsupervised Feature Learning with Convolutional Neural Networks
Alexey Dosovitskiy, Jost Tobias Springenberg, Martin A Riedmiller, and Thomas Brox · 2014
Cited alongside, same era.
Network In Network
Min Lin, Qiang Chen, and Shuicheng Yan · 2014
Cited alongside, same era.
On the Number of Linear Regions of Deep Neural Networks
Guido F Montúfar, Razvan Pascanu, Kyunghyun Cho, and Yoshua Bengio · 2014
Cited alongside, same era.
Very Deep Convolutional Networks for Large-Scale Image Recognition
Karen Simonyan and Andrew Zisserman · 2014
Cited alongside, same era.
DeepFace: Closing the Gap to Human-Level Performance in Face Verification
Yaniv Taigman, Ming Yang, Marc’Aurelio Ranzato, and Lior Wolf · 2014
Cited alongside, same era.
Deep Residual Learning for Image Recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun · 2016
Later among the works it cites.
Understanding the Effective Receptive Field in Deep Convolutional Neural Networks
Wenjie Luo, Yujia Li, Raquel Urtasun, and Richard S Zemel · 2016
Later among the works it cites.
Exponential expressivity in deep neural networks through transient chaos
Ben Poole, Subhaneil Lahiri, Maithreyi Raghu, Jascha Sohl-Dickstein, and Surya Ganguli · 2016
Later among the works it cites.
On the expressive power of deep neural networks
Maithra Raghu, Ben Poole, Jon Kleinberg, Surya Ganguli, and Jascha Sohl-Dickstein · 2016
Later among the works it cites.
Depth Separation in ReLU Networks for Approximating Smooth Non-Linear Functions
Itay Safran and Ohad Shamir · 2016
Later among the works it cites.
Tensorial Mixture Models
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Adam: A Method for Stochastic Optimization
Diederik Kingma and Jimmy Ba · 2015
Cited alongside, same era.
Striving for Simplicity: The All Convolutional Net
Jost Tobias Springenberg, Alexey Dosovitskiy, Thomas Brox, and Martin Riedmiller · 2015
Cited alongside, same era.
Going Deeper with Convolutions
Christian Szegedy, Wei Liu, Yangqing Jia, Pierre Sermanet, Scott Reed, Dragomir Anguelov, Dumitru Erhan, Vincent Vanhoucke, and Andrew Rabinovich · 2015
Cited alongside, same era.
Convolutional Rectifier Networks as Generalized Tensor Decompositions
Nadav Cohen and Amnon Shashua · 2016
Cited alongside, same era.
The Power of Depth for Feedforward Neural Networks
Ronen Eldan and Ohad Shamir · 2016
Cited alongside, same era.
On the Expressive Power of Deep Learning: A Tensor Analysis
Nadav Cohen, Or Sharir, and Amnon Shashua
Cited in the paper.
Deep SimNets
Nadav Cohen, Or Sharir, and Amnon Shashua
Cited in the paper.
Or Sharir, Ronen Tamari, Nadav Cohen, and Amnon Shashua · 2016
Later among the works it cites.
Benefits of depth in neural networks
Matus Telgarsky · 2016
Later among the works it cites.
Wavenet: A generative model for raw audio
Aaron van den Oord, Sander Dieleman, Heiga Zen, Karen Simonyan, Oriol Vinyals, Alex Graves, Nal Kalchbrenner, Andrew Senior, and Koray Kavukcuoglu · 2016
Later among the works it cites.
Globally Optimal Gradient Descent for a ConvNet with Gaussian Inputs
Alon Brutzkus and Amir Globerson · 2017
Closest in time.
Inductive Bias of Deep Convolutional Networks through Pooling Geometry
Nadav Cohen and Amnon Shashua · 2017
Closest in time.