Fetching the paper…
Reading the bibliography…
The state-of-the art machine learning approach to training deep neural networks, backpropagation, is implausible for real neural networks: neurons need to know their outgoing weights; training alternates between a bottom-up forward pass (computation) and a top-down backward pass (learning); and the algorithm often needs precise labels of many data points.
Contrastive hebbian learning in the continuous hopfield model
Javier R Movellan · 1991
Earlier work this paper cites.
The information bottleneck method
Naftali Tishby, Fernando C Pereira, and William Bialek · 2000
Earlier work this paper cites.
Equivalence of backpropagation and contrastive hebbian learning in a layered network
Xiaohui Xie and H Sebastian Seung · 2003
Earlier work this paper cites.
Measuring statistical dependence with hilbert-schmidt norms
Arthur Gretton, Olivier Bousquet, Alex Smola, and Bernhard Schölkopf · 2005
Earlier work this paper cites.
Learning multiple layers of features from tiny images
Alex Krizhevsky, Geoffrey Hinton, et al · 2009
Earlier work this paper cites.
Imagenet: A large-scale hierarchical image database
Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li, and Li Fei-Fei · 2009
Earlier work this paper cites.
Divisive normalization in olfactory population codes
Shawn R Olsen, Vikas Bhandawat, and Rachel I Wilson · 2010
Earlier work this paper cites.
Mnist handwritten digit database
Yann LeCun, Corinna Cortes, and CJ Burges · 2010
Earlier work this paper cites.
Perisynaptic glia discriminate patterns of motor nerve activity and influence plasticity at the neuromuscular junction
Keith J Todd, Houssam Darabid, and Richard Robitaille · 2010
Earlier work this paper cites.
Normalization as a canonical neural computation
Matteo Carandini and David J Heeger · 2012
Earlier work this paper cites.
Rectifier nonlinearities improve neural network acoustic models
Andrew L Maas, Awni Y Hannun, and Andrew Y Ng · 2013
Earlier work this paper cites.
How auto-encoders could provide credit assignment in deep networks via target propagation
Yoshua Bengio · 2014
Earlier work this paper cites.
Adam: A method for stochastic optimization
Diederik P Kingma and Jimmy Ba · 2014
Earlier work this paper cites.
Dropout: a simple way to prevent neural networks from overfitting
Nitish Srivastava, Geoffrey Hinton, Alex Krizhevsky, Ilya Sutskever, and Ruslan Salakhutdinov · 2014
Earlier work this paper cites.
How important is weight symmetry in backpropagation?
Qianli Liao, Joel Z Leibo, and Tomaso Poggio · 2015
Earlier work this paper cites.
Difference target propagation
Dong-Hyun Lee, Saizheng Zhang, Asja Fischer, and Yoshua Bengio · 2015
Earlier work this paper cites.
Batch normalization: Accelerating deep network training by reducing internal covariate shift
Sergey Ioffe and Christian Szegedy · 2015
Earlier work this paper cites.
Random synaptic feedback weights support error backpropagation for deep learning
Timothy P Lillicrap, Daniel Cownden, Douglas B Tweed, and Colin J Akerman · 2016
Cited alongside, same era.
Deep variational information bottleneck
Alexander A Alemi, Ian Fischer, Joshua V Dillon, and Kevin Murphy · 2016
Cited alongside, same era.
Direct feedback alignment provides learning in deep neural networks
Arild Nøkland · 2016
Cited alongside, same era.
Normalizing the normalizers: Comparing and extending network normalization schemes
Mengye Ren, Renjie Liao, Raquel Urtasun, Fabian H Sinz, and Richard S Zemel · 2016
Cited alongside, same era.
Opening the black box of deep neural networks via information
Ravid Shwartz-Ziv and Naftali Tishby · 2017
Deep supervised learning using local errors
Hesham Mostafa, Vishwajith Ramesh, and Gert Cauwenberghs · 2018
Later among the works it cites.
Why do similarity matching objectives lead to hebbian/anti-hebbian networks?
Cengiz Pehlevan, Anirvan M Sengupta, and Dmitri B Chklovskii · 2018
Later among the works it cites.
Group normalization
Yuxin Wu and Kaiming He · 2018
Later among the works it cites.
Representation learning with contrastive predictive coding
Aaron van den Oord, Yazhe Li, and Oriol Vinyals · 2018
Later among the works it cites.
A deep learning framework for neuroscience
Blake A Richards, Timothy P Lillicrap, Philippe Beaudoin, Yoshua Bengio, Rafal Bogacz, Amelia Christensen, Claudia Clopath, Rui Ponte Costa, Archy de Berker, Surya Ganguli, et al · 2019
Later among the works it cites.
Deep learning without weight transport
Mohamed Akrout, Collin Wilson, Peter Humphreys, Timothy Lillicrap, and Douglas B Tweed · 2019
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
Fashion-mnist: a novel image dataset for benchmarking machine learning algorithms, 2017
Han Xiao, Kashif Rasul, and Roland Vollgraf · 2017
Cited alongside, same era.
Equilibrium propagation: Bridging the gap between energy-based models and backpropagation
Benjamin Scellier and Yoshua Bengio · 2017
Cited alongside, same era.
Online learning with gated linear networks
Joel Veness, Tor Lattimore, Avishkar Bhoopchand, Agnieszka Grabska-Barwinska, Christopher Mattern, and Peter Toth · 2017
Cited alongside, same era.
A probabilistic approach to demixing odors
Agnieszka Grabska-Barwińska, Simon Barthelmé, Jeff Beck, Zachary F Mainen, Alexandre Pouget, and Peter E Latham · 2017
Cited alongside, same era.
Self-normalizing neural networks
Günter Klambauer, Thomas Unterthiner, Andreas Mayr, and Sepp Hochreiter · 2017
Cited alongside, same era.
Decoupled weight decay regularization
Ilya Loshchilov and Frank Hutter · 2017
Cited alongside, same era.
Dendritic cortical microcircuits approximate the backpropagation algorithm
João Sacramento, Rui Ponte Costa, Yoshua Bengio, and Walter Senn · 2018
Cited alongside, same era.
Later among the works it cites.
Greedy layerwise learning can scale to ImageNet
Eugene Belilovsky, Michael Eickenberg, and Edouard Oyallon · 2019
Later among the works it cites.
Training neural networks with local error signals
Arild Nøkland and Lars Hiller Eidnes · 2019
Later among the works it cites.
Putting an end to end-to-end: Gradient-isolated learning of representations
Sindy Löwe, Peter O’Connor, and Bastiaan Veeling · 2019
Later among the works it cites.
Joel Veness, Tor Lattimore, David Budden, Avishkar Bhoopchand, Christopher Mattern, Agnieszka Grabska-Barwinska, Eren Sezener, Jianan Wang, Peter Toth, Simon Schmitt, et al · 2019
Later among the works it cites.
Unsupervised learning by competing hidden units
Dmitry Krotov and John J Hopfield · 2019
Later among the works it cites.
Biologically plausible deep learning—but how far can we go with shallow networks?
Bernd Illing, Wulfram Gerstner, and Johanni Brea · 2019
Later among the works it cites.
The HSIC bottleneck: Deep learning without back-propagation
Kurt Wan-Duo Ma, J. P. Lewis, and W. Bastiaan Kleijn · 2020
Closest in time.
Scaling equilibrium propagation to deep convnets by drastically reducing its gradient estimator bias
Axel Laborieux, Maxence Ernoult, Benjamin Scellier, Yoshua Bengio, Julie Grollier, and Damien Querlioz · 2020
Closest in time.
Supervised deep similarity matching
Shanshan Qin, Nayantara Mudur, and Cengiz Pehlevan · 2020
Closest in time.
A simple framework for contrastive learning of visual representations
Ting Chen, Simon Kornblith, Mohammad Norouzi, and Geoffrey Hinton · 2020
Closest in time.
Modularizing deep learning via pairwise learning with kernels
Shiyu Duan, Shujian Yu, and Jose Principe · 2020
Closest in time.