Nearly-tight bounds on linear regions of piecewise linear neural networks

T. Zaslavsky. Facing up to arrangements: face-count formulas for partitions of space by hyperplanes . American Mathematical Society, 1975

1975

Earlier work this paper cites.

G. Cybenko. Approximation by superpositions of a sigmoidal function. Mathematics of Control, Signals and Systems , 2(4):303–314, 1989

1989

Earlier work this paper cites.

M. Anthony and P. Bartlett. Neural network learning: Theoretical foundations . Cambridge University Press, 1999

1999

Earlier work this paper cites.

O. Delalleau and Y. Bengio. Shallow vs. deep sum-product networks. In NIPS , 2011

2011

Earlier work this paper cites.

X. Glorot, A. Bordes, and Y. Bengio. Deep sparse rectifier neural networks. In AISTATS , 2011

2011

Earlier work this paper cites.

A. Krizhevsky, I. Sutskever, and G. Hinton. ImageNet Classification with deep convolutional neural networks. In NIPS , 2012

2012

Earlier work this paper cites.

G. Hinton, L. Deng, G. Dahl, et al. Deep neural networks for acoustic modeling in speech recognition. IEEE Signal Processing Magazine , 29(6):82–97, Nov. 2012

2012

Cited alongside, same era.

I. J. Goodfellow, D. Warde-Farley, M. Mirza, et al. Maxout networks. In ICML , 2013

2013

Cited alongside, same era.

I. J. Goodfellow, J. Pouget-Abadie, M. Mirza, et al. Generative adversarial nets. In NIPS , 2014

2014

Cited alongside, same era.

R. Pascanu, G. Montúfar, and Y. Bengio. On the number of response regions of deep feedforward networks with piecewise linear activations. In ICLR , 2014

2014

Cited alongside, same era.

G. Montúfar, R. Pascanu, K. Cho, and Y. Bengio. On the number of linear regions of deep neural networks. In NIPS , 2014

2014

Cited alongside, same era.

C. Szegedy, W. Liu, Y. Jia, et al. Going deeper with convolutions. In CVPR , 2015

2015

Later among the works it cites.

K. He, X. Zhang, S. Ren, and J. Sun. Deep residual learning for image recognition. In CVPR , 2016

2016

Later among the works it cites.

M. Raghu, B. Poole, J. Kleinberg, S. Ganguli, and J. S. Dickstein. On the expressive power of deep neural networks. In ICML , 2017

2017

Later among the works it cites.

R. Arora, A. Basu, P. Mianjy, and A. Mukherjee. Understanding deep neural networks with rectified linear units. In ICLR , 2018

2018

Closest in time.

T. Serra, C. Tjandraatmadja, and S. Ramalingam. Bounding and counting linear regions of deep neural networks. In ICML , 2018

2018

Closest in time.