Fetching the paper…
Reading the bibliography…
Training with backpropagation (BP) in standard deep learning consists of two main steps: a forward pass that maps a data point to its prediction, and a backward pass that propagates the error of this prediction back through the network.
Wiley, New York, 1949
D. Hebb, The Organization of Behavior · 1949
Earlier work this paper cites.
S. Linnainmaa, “The representation of the cumulative rounding error of an algorithm as a Taylor expansion of the local rounding errors,” Master’s Thesis (in Finnish), Univ. Helsinki
1970
Earlier work this paper cites.
M. V. Srinivasan, S. B. Laughlin, and A. Dubs, “Predictive coding: A fresh view of inhibition in the retina,” Proceedings of the Royal Society of London. Series B. Biological Sciences
1982
Earlier work this paper cites.
J. J. Hopfield, “Neural networks and physical systems with emergent collective computational abilities,” Proceedings of the National Academy of Sciences
1982
Earlier work this paper cites.
J. J. Hopfield, “Neurons with graded response have collective computational properties like those of two-state neurons,” Proceedings of the National Academy of Sciences
1984
Earlier work this paper cites.
D. E. Rumelhart, G. E. Hinton, and R. J. Williams, “Learning representations by back-propagating errors,” Nature
1986
Earlier work this paper cites.
F. J. Pineda, “Generalization of back-propagation to recurrent neural networks,” Physical Review Letters
1987
Earlier work this paper cites.
L. B. Almeida, “A learning rule for asynchronous perceptrons with feedback in a combinatorial environment,” pp. 102–111, 1990
1990
Earlier work this paper cites.
D. Mumford, “On the computational architecture of the neocortex,” Biological Cybernetics
1992
Earlier work this paper cites.
S. Hochreiter and J. Schmidhuber, “Long short-term memory,” Neural Computation
1997
Earlier work this paper cites.
R. P. Rao and D. H. Ballard, “Predictive coding in the visual cortex: A functional interpretation of some extra-classical receptive-field effects,” Nature Neuroscience
1999
Earlier work this paper cites.
K. Friston, “Learning and inference in the brain,” Neural Networks
2003
Earlier work this paper cites.
K. Friston, “A theory of cortical responses,” Philosophical Transactions of the Royal Society B: Biological Sciences
2005
Earlier work this paper cites.
R. Salakhutdinov, A. Mnih, and G. Hinton, “Restricted Boltzmann machines for collaborative filtering,” in Proceedings of the 24th International Conference on Machine Learning
2007
Earlier work this paper cites.
K. J. Friston, N. Trujillo-Barreto, and J. Daunizeau, “DEM: A variational treatment of dynamic systems,” Neuroimage
2008
Earlier work this paper cites.
J. Hohwy, A. Roepstorff, and K. Friston, “Predictive coding explains binocular rivalry: An epistemological review,” Cognition
2008
Earlier work this paper cites.
D. B. Strukov, G. S. Snider, D. R. Stewart, and R. S. Williams, “The missing memristor found,” Nature
2008
Earlier work this paper cites.
R. Salakhutdinov and G. Hinton, “Deep Boltzmann machines,” in Artificial Intelligence and Statistics
2009
Earlier work this paper cites.
G. E. Hinton, “Deep belief networks,” Scholarpedia
2009
Earlier work this paper cites.
H. Feldman and K. Friston, “Attention, uncertainty, and free-energy,” Frontiers in Human Neuroscience
2010
Earlier work this paper cites.
Y. Huang and R. P. Rao, “Predictive coding,” Wiley Interdisciplinary Reviews: Cognitive Science
2011
Cited alongside, same era.
Y. Netzer, T. Wang, A. Coates, A. Bissacco, B. Wu, and A. Y. Ng, “Reading digits in natural images with unsupervised feature learning,” 2011
2011
Cited alongside, same era.
Q. K. Telesford, K. E. Joyce, S. Hayasaka, J. H. Burdette, and P. J. Laurienti, “The ubiquity of small-world networks,” Brain Connectivity
2011
Cited alongside, same era.
A. M. Bastos, W. M. Usrey, R. A. Adams, G. R. Mangun, P. Fries, and K. J. Friston, “Canonical microcircuits for predictive coding,” Neuron
2012
Cited alongside, same era.
R. Kanai, Y. Komura, S. Shipp, and K. Friston, “Cerebral hierarchies: Predictive processing, precision and the pulvinar,” Philosophical Transactions of the Royal Society B: Biological Sciences
2015
J. C. Whittington and R. Bogacz, “Theories of error back-propagation in the brain,” Trends in Cognitive Sciences
2019
Later among the works it cites.
A. G. Ororbia and A. Mali, “Biologically motivated algorithms for propagating local target representations,” in Proc. AAAI
2019
Later among the works it cites.
K. S. Walsh, D. P. McGovern, A. Clark, and R. G. O’Connell, “Evaluating the neurophysiological evidence for predictive processing as a model of perception,” Annals of the New York Academy of Sciences
2020
Later among the works it cites.
H. C. Barron, R. Auksztulewicz, and K. Friston, “Prediction and memory: A predictive coding account,” Progress in Neurobiology
2020
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
R. Auksztulewicz and K. Friston, “Repetition suppression and its contextual determinants in predictive coding,” Cortex
2016
Cited alongside, same era.
2016
Cited alongside, same era.
D. Krotov and J. J. Hopfield, “Dense associative memory for pattern recognition,” in Advances in Neural Information Processing Systems
2016
Cited alongside, same era.
K. J. Friston, T. Parr, and B. de Vries, “The graphical brain: Belief propagation and active inference,” Network Neuroscience
2017
Cited alongside, same era.
M. W. Spratling, “A review of predictive coding algorithms,” Brain and Cognition
2017
Cited alongside, same era.
J. C. Whittington and R. Bogacz, “An approximation of the error backpropagation algorithm in a predictive coding network with local Hebbian synaptic plasticity,” Neural Computation
2017
Cited alongside, same era.
2017
Cited alongside, same era.
2020
Later among the works it cites.
Y. Song, T. Lukasiewicz, Z. Xu, and R. Bogacz, “Can the brain do backpropagation? — Exact implementation of backpropagation in predictive coding networks,” in Advances in Neural Information Processing Systems
2020
Later among the works it cites.
C. H. Papadimitriou, S. S. Vempala, D. Mitropolsky, M. Collins, and W. Maass, “Brain computation by assemblies of neurons,” Proceedings of the National Academy of Sciences
2020
Later among the works it cites.
M. A. Belyaev and A. A. Velichko, “Classification of handwritten digits using the Hopfield network,” in IOP Conference Series: Materials Science and Engineering
2020
Later among the works it cites.
2020
Later among the works it cites.
T. Lillicrap, A. Santoro, L. Marris, C. Akerman, and G. Hinton, “Backpropagation and the brain,” Nature Reviews Neuroscience
2020
Later among the works it cites.
2020
Later among the works it cites.
2020
Later among the works it cites.
2020
Later among the works it cites.
2021
Later among the works it cites.
T. Salvatori, Y. Song, Y. Hong, L. Sha, S. Frieder, Z. Xu, R. Bogacz, and T. Lukasiewicz, “Associative memories via predictive coding,” in Advances in Neural Information Processing Systems
2021
Later among the works it cites.
2021
Later among the works it cites.
T. Salvatori, Y. Song, T. Lukasiewicz, R. Bogacz, and Z. Xu, “Reverse differentiation via predictive coding,” in Proc. AAAI
2022
Closest in time.
2022
Closest in time.
L. G. Wright, T. Onodera, M. M. Stein, T. Wang, D. T. Schachter, Z. Hu, and P. L. McMahon, “Deep physical neural networks trained with backpropagation,” Nature
2022
Closest in time.