Fetching the paper…
Reading the bibliography…
We present results on the number of linear regions of the functions that can be represented by artificial feedforward neural networks with maxout units.
Partition of space
R. C. Buck · 1943
Earlier work this paper cites.
On the foundations of combinatorial theory I. Theory of Möbius functions
G.-C. Rota · 1964
Earlier work this paper cites.
Convex Analysis
R. T. Rockafellar · 1970
Earlier work this paper cites.
Facing up to Arrangements: Face-Count Formulas for Partitions of Space by Hyperplanes
T. Zaslavsky · 1975
Earlier work this paper cites.
A combinatorial analysis of topological dissections
T. Zaslavsky · 1977
Earlier work this paper cites.
On the interpretation of Whitney numbers through arrangements of hyperplanes, zonotopes, non-Radon partitions, and orientations of graphs
C. Greene and T. Zaslavsky · 1983
Earlier work this paper cites.
Almost optimal lower bounds for small depth circuits
J. Håstad · 1986
Earlier work this paper cites.
On the power of small-depth threshold circuits
J. Håstad and M. Goldmann · 1991
Earlier work this paper cites.
Minkowski addition of polytopes: Computational complexity and applications to Gröbner bases
P. Gritzmann and B. Sturmfels · 1993
Earlier work this paper cites.
Lectures on polytopes
G. M. Ziegler · 1995
Earlier work this paper cites.
Tame Topology and O-minimal Structures
L. Van den Dries · 1998
Earlier work this paper cites.
Arrangements of Hyperplanes
B. Grünbaum · 2003
Earlier work this paper cites.
Asymptotic mean values of Gaussian polytopes
D. Hug, G. O. Munsonius, and M. Reitzner · 2004
Earlier work this paper cites.
An introduction to hyperplane arrangements
R. P. Stanley · 2004
Earlier work this paper cites.
General constructive representations for continuous piecewise-linear functions
S. Wang · 2004
Earlier work this paper cites.
Tropical linear spaces
D. E. Speyer · 2008
Earlier work this paper cites.
Tropical hyperplane arrangements and oriented matroids
F. Ardila and M. Develin · 2009
Earlier work this paper cites.
Shallow vs. deep sum-product networks
O. Delalleau and Y. Bengio · 2011
Earlier work this paper cites.
Deep sparse rectifier neural networks
X. Glorot, A. Bordes, and Y. Bengio · 2011
Earlier work this paper cites.
Maximal f-vectors of Minkowski sums of large numbers of polytopes
C. Weibel · 2012
Cited alongside, same era.
Maxout networks
I. Goodfellow, D. Warde-Farley, M. Mirza, A. Courville, and Y. Bengio · 2013
Cited alongside, same era.
The maximum number of faces of the Minkowski sum of three convex polytopes
M. I. Karavelas, C. Konaxis, and E. Tzanaki · 2013
Cited alongside, same era.
On the number of response regions of deep feed forward networks with piece-wise linear activations
R. Pascanu, G. Montúfar, and Y. Bengio · 2013
Cited alongside, same era.
On the number of linear regions of deep neural networks
G. Montúfar, R. Pascanu, K. Cho, and Y. Bengio · 2014
Cited alongside, same era.
Deep networks are effective encoders of periodicity
L. Szymanski and B. McCane · 2014
Cited alongside, same era.
Understanding deep neural networks with rectified linear units
R. Arora, A. Basu, P. Mianjy, and A. Mukherjee · 2018
Later among the works it cites.
A tropical approach to neural networks with piecewise linear activations
V. Charisopoulos and P. Maragos · 2018
Later among the works it cites.
How to start training: The effect of initialization and architecture
B. Hanin and D. Rolnick · 2018
Later among the works it cites.
Bounding and counting linear regions of deep neural networks
T. Serra, C. Tjandraatmadja, and S. Ramalingam · 2018
Later among the works it cites.
Tropical geometry of deep neural networks
L. Zhang, G. Naitzat, and L.-H. Lim · 2018
Later among the works it cites.
The geometry of deep networks: Power diagram subdivision
R. Balestriero, R. Cosentino, B. Aazhang, and R. Baraniuk · 2019
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Delving deep into rectifiers: Surpassing human-level performance on imagenet classification
K. He, X. Zhang, S. Ren, and J. Sun · 2015
Cited alongside, same era.
Introduction to tropical geometry
D. Maclagan and B. Sturmfels · 2015
Cited alongside, same era.
Representation benefits of deep feedforward networks
M. Telgarsky · 2015
Cited alongside, same era.
Relative Stanley–Reisner theory and upper bound theorems for Minkowski sums
K. A. Adiprasito and R. Sanyal · 2016
Cited alongside, same era.
The power of depth for feedforward neural networks
R. Eldan and O. Shamir · 2016
Cited alongside, same era.
The maximum number of faces of the Minkowski sum of two convex polytopes
M. I. Karavelas and E. Tzanaki · 2016
Cited alongside, same era.
Later among the works it cites.
Nearly-tight VC-dimension and pseudodimension bounds for piecewise linear neural networks
P. L. Bartlett, N. Harvey, C. Liaw, and A. Mehrabian · 2019
Later among the works it cites.
Complexity of linear regions in deep networks
B. Hanin and D. Rolnick · 2019
Later among the works it cites.
Deep ReLU networks have surprisingly few activation patterns
B. Hanin and D. Rolnick · 2019
Later among the works it cites.
A framework for the construction of upper bounds on the number of affine linear regions of ReLU feed-forward neural networks
P. Hinz and S. van de Geer · 2019
Later among the works it cites.
A sober look at neural network initializations
I. Steinwart · 2019
Later among the works it cites.
On the decision boundaries of deep neural networks: A tropical geometry perspective
M. Alfarra, A. Bibi, H. Hammoud, M. Gaafar, and B. Ghanem · 2020
Later among the works it cites.
Implicit bias of gradient descent for mean squared error regression with wide neural networks
H. Jin and G. Montúfar · 2020
Later among the works it cites.
Empirical bounds on linear regions of deep rectifier networks
T. Serra and S. Ramalingam · 2020
Later among the works it cites.
On the number of linear regions of convolutional neural networks
H. Xiong, L. Huang, M. Yu, L. Liu, F. Zhu, and L. Shao · 2020
Later among the works it cites.
Empirical studies on the properties of linear regions in deep neural networks
X. Zhang and D. Wu · 2020
Later among the works it cites.
Weisfeiler and lehman go topological: Message passing simplicial networks
C. Bodnar, F. Frasca, Y. Wang, N. Otter, G. Montúfar, P. Lió, and M. Bronstein · 2021
Closest in time.
Essentials of tropical combinatorics
M. Joswig · 2021
Closest in time.
Tight bounds on the smallest eigenvalue of the neural tangent kernel for deep relu networks
Q. Nguyen, M. Mondelli, and G. Montúfar · 2021
Closest in time.