Fetching the paper…
Reading the bibliography…
We discuss relations between Residual Networks (ResNet), Recurrent Neural Networks (RNNs) and the primate visual cortex.
Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position
Fukushima, K. (1980) · 1980
Earlier work this paper cites.
Learning complex, extended sequences using the principle of history compression
Schmidhuber, J. (1992) · 1992
Earlier work this paper cites.
On the computational power of neural nets
Siegelmann, H. T. and Sontag, E. D. (1992) · 1992
Earlier work this paper cites.
Speed of processing in the human visual system
Thorpe, S., Fize, D., Marlot, C., et al. (1996) · 1996
Earlier work this paper cites.
Modulation of connectivity in visual pathways by attention: cortical interactions evaluated with structural equation modelling and fmri
Büchel, C. and Friston, K. (1997) · 1997
Earlier work this paper cites.
Long short-term memory
Hochreiter, S. and Schmidhuber, J. (1997) · 1997
Earlier work this paper cites.
Cortical feedback improves discrimination between figure and background by v1, v2 and v3 neurons
Hupe, J., James, A., Payne, B., Lomber, S., Girard, P., and Bullier, J. (1998) · 1998
Earlier work this paper cites.
Feedforward, horizontal, and feedback processing in the visual cortex
Lamme, V. A., Super, H., and Spekreijse, H. (1998) · 1998
Earlier work this paper cites.
Attention modulates contextual influences in the primary visual cortex of alert monkeys
Ito, M. and Gilbert, C. D. (1999) · 1999
Earlier work this paper cites.
Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects
Rao, R. P. and Ballard, D. H. (1999) · 1999
Earlier work this paper cites.
Hierarchical models of object recognition in cortex
Riesenhuber, M. and Poggio, T. (1999) · 1999
Earlier work this paper cites.
A feedforward architecture accounts for rapid categorization
Serre, T., Oliva, A., and Poggio, T. (2007) · 2007
Earlier work this paper cites.
Learning multiple layers of features from tiny images
Krizhevsky, A. (2009) · 2009
Cited alongside, same era.
Deconvolutional networks
Zeiler, M. D., Krishnan, D., Taylor, G. W., and Fergus, R. (2010) · 2010
Cited alongside, same era.
Lessons learned from manually classifying cifar-10
Karpathy, A. (2011) · 2011
Cited alongside, same era.
Parsing natural scenes and natural language with recursive neural networks
Socher, R., Lin, C. C., Manning, C., and Ng, A. Y. (2011) · 2011
Cited alongside, same era.
Imagenet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., and Hinton, G. E. (2012) · 2012
Cited alongside, same era.
Understanding deep architectures using a recursive convolutional network
Eigen, D., Rolfe, J., Fergus, R., and LeCun, Y. (2013) · 2013
Batch normalized recurrent neural networks
Laurent, C., Pereyra, G., Brakel, P., Zhang, Y., and Bengio, Y. (2015) · 2015
Later among the works it cites.
A simple way to initialize recurrent networks of rectified linear units
Le, Q. V., Jaitly, N., and Hinton, G. E. (2015) · 2015
Later among the works it cites.
Recurrent convolutional neural network for object recognition
Liang, M. and Hu, X. (2015) · 2015
Later among the works it cites.
How important is weight symmetry in backpropagation?
Liao, Q., Leibo, J. Z., and Poggio, T. (2015) · 2015
Later among the works it cites.
Srivastava, R. K., Greff, K., and Schmidhuber, J. (2015) · 2015
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
Generating sequences with recurrent neural networks
Graves, A. (2013) · 2013
Cited alongside, same era.
How to construct deep recurrent neural networks
Pascanu, R., Gulcehre, C., Cho, K., and Bengio, Y. (2013) · 2013
Cited alongside, same era.
Recurrent convolutional neural networks for scene parsing
Pinheiro, P. H. and Collobert, R. (2013) · 2013
Cited alongside, same era.
On the number of linear regions of deep neural networks
Montufar, G. F., Pascanu, R., Cho, K., and Bengio, Y. (2014) · 2014
Cited alongside, same era.
Striving for simplicity: The all convolutional net
Springenberg, J. T., Dosovitskiy, A., Brox, T., and Riedmiller, M. (2014) · 2014
Cited alongside, same era.
Batch normalization: Accelerating deep network training by reducing internal covariate shift
Ioffe, S. and Szegedy, C. (2015) · 2015
Cited alongside, same era.
Later among the works it cites.
Matconvnet: Convolutional neural networks for matlab
Vedaldi, A. and Lenc, K. (2015) · 2015
Later among the works it cites.
Loopy neural nets: Imitating feedback loops in the human brain
Caswell, I., Shen, C., and Wang, L. (2016, http://cs231n.stanford.edu/reports2016/110_Report.pdf · 2016
Closest in time.
How deep is the feature analysis underlying rapid visual categorization?
Eberhardt, S., Cader, J., and Serre, T. (2016) · 2016
Closest in time.
Identity mappings in deep residual networks
He, K., Zhang, X., Ren, S., and Sun, J. (2016) · 2016
Closest in time.
Deep networks with stochastic depth
Huang, G., Sun, Y., Liu, Z., Sedra, D., and Weinberger, K. (2016) · 2016
Closest in time.
Learning real and boolean functions: When is deep better than shallow
Mhaskar, H., Liao, Q., and Poggio, T. (2016) · 2016
Closest in time.
Using goal-driven deep learning models to understand sensory cortex
Yamins, D. and Dicarlo, J. (2016) · 2016
Closest in time.