Fetching the paper…
Reading the bibliography…
We present a framework to derive upper bounds on the number of regions that feed-forward neural networks with ReLU activation functions are affine linear on.
T. Zaslavsky, “Facing up to arrangements: Face-count formulas for partitions of space by hyperplanes: Face-count formulas for partitions of space by hyperplanes,” American Mathematical Soc
1975
Earlier work this paper cites.
H. Pottmann, R. Krasauskas, B. Hamann, K. Joy, and W. Seibold, “On piecewise linear approximation of quadratic functions,” Journal for Geometry and Graphics Volume
2000
Earlier work this paper cites.
P. L. Bartlett and S. Mendelson, “Empirical minimization,” Probability Theory and Related Fields
2006
Earlier work this paper cites.
G. Montúfar, R. Pascanu, K. Cho, and Y. Bengio, “On the number of linear regions of deep neural networks,” in Proceedings of the 27th International Conference on Neural Information Processing Systems - Volume 2
2014
Cited alongside, same era.
2016
Cited alongside, same era.
G. Montúfar, “Notes on the number of linear regions of deep neural networks,” 03 2017
2017
Cited alongside, same era.
2017
Later among the works it cites.
M. Raghu, B. Poole, J. Kleinberg, S. Ganguli, and J. Sohl-Dickstein, “On the expressive power of deep neural networks,” in Proceedings of the 34th International Conference on Machine Learning
2017
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…