Fetching the paper…
Reading the bibliography…
In this work, we propose a novel technique to boost training efficiency of a neural network.
Eigenvalues of covariance matrices: Application to neural-network learning
Le Cun, Y., Kanter, I., and Solla, S. A · 1991
Earlier work this paper cites.
Edges are the’independent components’ of natural scenes
Bell, A. J. and Sejnowski, T. J · 1997
Earlier work this paper cites.
Independent component analysis
Oja, H. and Nordhausen, K · 2006
Earlier work this paper cites.
Learning multiple layers of features from tiny images
Krizhevsky, A. and Hinton, G · 2009
Earlier work this paper cites.
Efficient backprop
LeCun, Y. A., Bottou, L., Orr, G. B., and Müller, K.-R · 2012
Earlier work this paper cites.
Information-limiting correlations
Moreno-Bote, R., Beck, J., Kanitscheider, I., Pitkow, X., Latham, P., and Pouget, A · 2014
Earlier work this paper cites.
Dropout: a simple way to prevent neural networks from overfitting
Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., and Salakhutdinov, R · 2014
Earlier work this paper cites.
Delving deep into rectifiers: Surpassing human-level performance on imagenet classification
He, K., Zhang, X., Ren, S., and Sun, J · 2015
Cited alongside, same era.
Batch normalization: Accelerating deep network training by reducing internal covariate shift
Ioffe, S. and Szegedy, C · 2015
Cited alongside, same era.
Imagenet large scale visual recognition challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al · 2015
Cited alongside, same era.
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A · 2015
Cited alongside, same era.
Ba, J. L., Kiros, J. R., and Hinton, G. E · 2016
Cited alongside, same era.
Enhanced dendritic compartmentalization in human cortical neurons
Beaulieu-Laroche, L., Toloza, E. H., van der Goes, M.-S., Lafourcade, M., Barnagian, D., Williams, Z. M., Eskandar, E. N., Frosch, M. P., Cash, S. S., and Harnett, M. T · 2018
Later among the works it cites.
Understanding batch normalization
Bjorck, J., Gomes, C., Selman, B., and Weinberger, K. Q · 2018
Later among the works it cites.
Decorrelated batch normalization
Huang, L., Yang, D., Lang, B., and Deng, J · 2018
Later among the works it cites.
Understanding the disharmony between dropout and batch normalization by variance shift
Li, X., Chen, S., Hu, X., and Yang, J · 2018
Later among the works it cites.
How does batch normalization help optimization?
Santurkar, S., Tsipras, D., Ilyas, A., and Madry, A · 2018
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Ulyanov, D., Vedaldi, A., and Lempitsky, V. S · 2016
Cited alongside, same era.
Batch renormalization: Towards reducing minibatch dependence in batch-normalized models
Ioffe, S · 2017
Cited alongside, same era.
Deep residual learning for image recognition
He, K., Zhang, X., Ren, S., and Sun, J
Cited in the paper.
Identity mappings in deep residual networks
He, K., Zhang, X., Ren, S., and Sun, J
Cited in the paper.
Wu, Y. and He, K · 2018
Later among the works it cites.