Neural Network Module Decomposition and Recomposition

Catastrophic Interference in Connectionist Networks: The Sequential Learning Problem

McCloskey, M.; and Cohen, N. J. 1989 · 1989

Earlier work this paper cites.

Efficient classification for multiclass problems using modular neural networks

Anand, R.; Mehrotra, K.; Mohan, C. K.; and Ranka, S. 1995 · 1995

Earlier work this paper cites.

Gradient-Based Learning Applied to Document Recognition

LeCun, Y.; Bottou, L.; Bengio, Y.; and Haffner, P. 1998 · 1998

Earlier work this paper cites.

Modular neural networks: a survey

Auda, G.; and Kamel, M. 1999 · 1999

Earlier work this paper cites.

Learning multiple layers of features from tiny images

Krizhevsky, A.; and Hinton, G. 2009 · 2009

Earlier work this paper cites.

Reading Digits in Natural Images with Unsupervised Feature Learning

Netzer, Y.; Wang, T.; Coates, A.; Bissacco, A.; Wu, B.; and Ng, A. Y. 2011 · 2011

Earlier work this paper cites.

Network In Network

Lin, M.; Chen, Q.; and Yan, S. 2014 · 2014

Earlier work this paper cites.

Delving deep into rectifiers: Surpassing human-level performance on imagenet classification

He, K.; Zhang, X.; Ren, S.; and Sun, J. 2015 · 2015

Earlier work this paper cites.

Very Deep Convolutional Networks for Large-Scale Image Recognition

Simonyan, K.; and Zisserman, A. 2015 · 2015

Earlier work this paper cites.

Deep Residual Learning for Image Recognition

He, K.; Zhang, X.; Ren, S.; and Sun, J. 2016 · 2016

Cited alongside, same era.

Convolutional neural networks with low-rank regularization

Tai, C.; Xiao, T.; Wang, X.; and E, W. 2016 · 2016

Cited alongside, same era.

Wide Residual Networks

Original

Zagoruyko, S.; and Komodakis, N. 2016 · 2016

Cited alongside, same era.

Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms

Xiao, H.; Rasul, K.; and Vollgraf, R. 2017 · 2017

Cited alongside, same era.

Piggyback: Adapting a Single Network to Multiple Tasks by Learning to Mask Weights

Mallya, A.; Davis, D.; and Lazebnik, S. 2018 · 2018

Cited alongside, same era.

Modular representation of layered neural networks

Watanabe, C.; Hiramatsu, K.; and Kashino, K. 2018 · 2018

Investigating the Compositional Structure Of Deep Neural Networks

Craighero, F.; Angaroni, F.; Graudenzi, A.; Stella, F.; and Antoniotti, M. 2020 · 2020

Later among the works it cites.

RandAugment: Practical Automated Data Augmentation with a Reduced Search Space

Cubuk, E. D.; Zoph, B.; Shlens, J.; and Le, Q. 2020 · 2020

Later among the works it cites.

Neural Networks are Surprisingly Modular

Filan, D.; Hod, S.; Wild, C.; Critch, A.; and Russell, S. 2020 · 2020

Later among the works it cites.

Compositionality Decomposed: How do Neural Networks Generalise? (Extended Abstract)

Hupkes, D.; Dankers, V.; Mul, M.; and Bruni, E. 2020 · 2020

Later among the works it cites.

On decomposing a deep neural network into modules

Pan, R.; and Rajan, H. 2020 · 2020

Later among the works it cites.

What’s Hidden in a Randomly Weighted Neural Network?

Ramanujan, V.; Wortsman, M.; Kembhavi, A.; Farhadi, A.; and Rastegari, M. 2020 · 2020