Fetching the paper…
Reading the bibliography…
While the backpropagation of error algorithm enables deep neural network training, it implies (i) bidirectional synaptic weight transport and (ii) update locking until the forward and backward passes are completed.
F. Rosenblatt, Principles of neurodynamics: Perceptrons and the theory of brain mechanisms
1961
Earlier work this paper cites.
M. Minsky, “Steps toward artificial intelligence,” Proceedings of the IRE
1961
Earlier work this paper cites.
D. Rumelhart, G. Hinton and R. Williams, “Learning representations by back-propagating errors,” Nature
1986
Earlier work this paper cites.
S. Grossberg, “Competitive learning: From interactive activation to adaptive resonance,” Cognitive Science
1987
Earlier work this paper cites.
Y. LeCun and C. Cortes, “The MNIST database of handwritten digits,” 1998 [Online]. Available: http://yann.lecun.com/exdb/mnist/
1998
Earlier work this paper cites.
G. G. Bi, and M. M. Poo, “Synaptic modifications in cultured hippocampal neurons: Dependence on spike timing, synaptic strength, and postsynaptic cell type,” Journal of Neuroscience
1998
Earlier work this paper cites.
D. Bassett and E. D. Bullmore, “Small-world brain networks,” The Neuroscientist
2006
Earlier work this paper cites.
J. M. Brader, W. Senn and S. Fusi, “Learning real-world stimuli in a neural network with spike-driven synaptic dynamics,” Neural Computation
2007
Earlier work this paper cites.
A. Krizhevsky, Learning multiple layers of features from tiny images
2009
Earlier work this paper cites.
J. Deng et al., “ImageNet: A large-scale hierarchical image database,” Proc. of IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
2009
Earlier work this paper cites.
F. Pedregosa et al., “Scikit-learn: Machine Learning in Python”, Journal of Machine Learning Research (JMLR)
2011
Earlier work this paper cites.
A. Krizhevsky, I. Sutskever and G. E. Hinton, “ImageNet classification with deep convolutional neural networks,” Proc. of Advances in Neural Information Processing Systems (NeurIPS)
2012
Earlier work this paper cites.
G. E. Hinton et al., “Deep neural networks for acoustic modeling in speech recognition,” IEEE Signal Processing Magazine
2012
Earlier work this paper cites.
R. Urbanczik and W. Senn, “Learning by the dendritic prediction of somatic spiking,” Neuron
2014
Earlier work this paper cites.
M. Horowitz, “Computing’s energy problem (and what we can do about it),” Proc. of IEEE International Solid-State Circuits Conference (ISSCC),
2014
Earlier work this paper cites.
Y. LeCun, Y. Bengio, and G. E. Hinton, “Deep learning,” Nature
2015
Earlier work this paper cites.
D. H. Lee et al., “Difference target propagation,” in Proc. of Springer Joint European Conference on Machine Learning and Knowledge Discovery in Databases
2015
Earlier work this paper cites.
D. Bol, G. de Streel and D. Flandre, “Can we connect trillions of IoT sensors in a sustainable way? A technology/circuit perspective,” Proc. of IEEE SOI-3D-Subthreshold Microelectronics Technology Unified Conference (S3S)
2015
Cited alongside, same era.
S. Ioffe and C. Szegedy, “Batch normalization: Accelerating deep network training by reducing internal covariate shift,” arXiv preprint arXiv1502.03167, 2015
2015
Cited alongside, same era.
K. He et al., “Delving deep into rectifiers: Surpassing human-level performance on ImageNet classification,” Proc. of IEEE International Conference on Computer Vision (ICCV)
2015
Cited alongside, same era.
F. Zenke, E. J. Agnes and W. Gerstner, “Diverse synaptic plasticity mechanisms orchestrated to form and retrieve memories in spiking neural networks”, Nature Communications
2015
Cited alongside, same era.
H. Mostafa, V. Ramesh and G. Cauwenberghs, “Deep supervised learning using local errors”, Frontiers in Neuroscience
2018
Later among the works it cites.
J. Kaiser, H. Mostafa and E. Neftci, “Synaptic plasticity dynamics for deep continuous local learning (DECOLLE),” Frontiers in Neuroscience
2018
Later among the works it cites.
S. Bartunov et al., “Assessing the scalability of biologically-motivated deep learning algorithms and architectures,” Proc. of Advances in Neural Information Processing Systems (NeurIPS)
2018
Later among the works it cites.
C. S. Thakur et al., “Large-scale neuromorphic spiking array processors: A quest to mimic the brain,” Frontiers in Neuroscience
2018
Later among the works it cites.
G. Detorakis et al., “Neural and synaptic array transceiver: A brain-inspired computing framework for embedded learning,” Frontiers in Neuroscience
2018
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
K. He et al., “Deep residual learning for image recognition,” Proc. of IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
2016
Cited alongside, same era.
D. Amodei et al., “Deep speech 2: End-to-end speech recognition in english and mandarin,” Proc. of International Conference on Machine Learning (ICML)
2016
Cited alongside, same era.
Q. Liao, J. Z. Leibo and T. Poggio, “How important is weight symmetry in backpropagation?,” Proc. of AAAI Conference on Artificial Intelligence
2016
Cited alongside, same era.
T. P. Lillicrap et al., “Random synaptic feedback weights support error backpropagation for deep learning,” Nature Communications
2016
Cited alongside, same era.
A. Nøkland, “Direct feedback alignment provides learning in deep neural networks,” Proc. of Advances in Neural Information Processing Systems (NeurIPS)
2016
Cited alongside, same era.
J. Guerguiev, T. P. Lillicrap and A. Richards, “Towards deep learning with segregated dendrites,” ELife
2017
Cited alongside, same era.
E. Neftci et al., “Event-driven random back-propagation: Enabling neuromorphic deep learning machines,” Frontiers in Neuroscience
2017
Cited alongside, same era.
M. Jaderberg et al., “Decoupled neural interfaces using synthetic gradients,” Proc. of International Conference on Machine Learning (ICML)
2017
Cited alongside, same era.
Later among the works it cites.
B. Crafton et al., “Local learning in RRAM neural networks with sparse direct feedback alignment,” IEEE/ACM International Symposium on Low Power Electronics and Design (ISLPED)
2019
Closest in time.
A. G. Ororbia and A. Mali, “Biologically motivated algorithms for propagating local target representations,” Proceedings of the AAAI Conference on Artificial Intelligence
2019
Closest in time.
A. Nøkland and L. H. Eidnes, “Training neural networks with local error signals”, Proc. of International Conference on Machine Learning (ICML)
2019
Closest in time.
2019
Closest in time.
C. Frenkel et al., “A 0.086-mm 2 12.7-pJ/SOP 64k-synapse 256-neuron online-learning digital spiking neuromorphic processor in 28-nm CMOS,” IEEE Transactions on Biomedical Circuits and Systems
2019
Closest in time.
C. Frenkel, J.-D. Legat and D. Bol, “MorphIC: A 65-nm 738k-synapse/mm 2 quad-core binary-weight digital neuromorphic processor with stochastic spike-driven online learning”, IEEE Transactions on Biomedical Circuits and Systems
2019
Closest in time.
B. Rajendran et al., “Low-Power Neuromorphic Hardware for Signal Processing Applications”, IEEE Signal Processing Magazine
2019
Closest in time.
J. Park, J. Lee and D. Jeon, “A 65-nm neuromorphic image classification processor with energy-efficient training through direct spike-only feedback,” IEEE Journal of Solid-State Circuits
2019
Closest in time.
2019
Closest in time.
C. Frenkel, J.-D. Legat and D. Bol, “A 28-nm convolutional neuromorphic processor enabling online learning with spike-based retinas,” IEEE International Symposium on Circuits and Systems (ISCAS)
2020
Closest in time.
J. C. Magee and C. Grienberger, “Synaptic plasticity forms and functions,” Annual review of neuroscience
2020
Closest in time.