Fetching the paper…
Reading the bibliography…
In this work, we tackle the problems of efficiency and scalability for predictive coding networks (PCNs) in machine learning.
Maximum likelihood from incomplete data via the EM algorithm
Arthur Dempster, Nan Laird, and Donald B. Rubin · 1977
Earlier work this paper cites.
Predictive coding in the visual cortex: A functional interpretation of some extra-classical receptive-field effects
Rajesh P. N. Rao and Dana H. Ballard · 1999
Earlier work this paper cites.
A theory of cortical responses
Karl Friston · 2005
Earlier work this paper cites.
Variational free energy and the Laplace approximation
Karl Friston, Jérémie Mattout, Nelson Trujillo-Barreto, John Ashburner, and Will Penny · 2007
Earlier work this paper cites.
Reconciling predictive coding and biased competition models of cortical function
Michael W. Spratling · 2008
Earlier work this paper cites.
Predictive coding under the free-energy principle
Karl Friston and Stefan Kiebel · 2009
Earlier work this paper cites.
Learning multiple layers of features from tiny images
Alex Krizhevsky, Geoffrey Hinton, et al · 2009
Earlier work this paper cites.
The free-energy principle: A unified brain theory?
Karl Friston · 2010
Earlier work this paper cites.
MNIST handwritten digit database
Yann LeCun and Corinna Cortes · 2010
Earlier work this paper cites.
Scikit-learn: Machine learning in Python
Fabian Pedregosa, Gaël Varoquaux, Alexandre Gramfort, Vincent Michel, Bertrand Thirion, Olivier Grisel, Mathieu Blondel, Peter Prettenhofer, Ron Weiss, Vincent Dubourg, Jake Vanderplas, Alexandre Passos, David Cournapeau, Matthieu Brucher, Matthieu Perrot, and Édouard Duchesnay · 2011
Earlier work this paper cites.
Auto-encoding variational Bayes
Diederik P. Kingma and Max Welling · 2013
Earlier work this paper cites.
How auto-encoders could provide credit assignment in deep networks via target propagation
Yoshua Bengio · 2014
Earlier work this paper cites.
Random feedback weights support learning in deep neural networks
Timothy P. Lillicrap, Daniel Cownden, Douglas B. Tweed, and Colin J. Akerman · 2014
Earlier work this paper cites.
Very deep convolutional networks for large-scale image recognition
Karen Simonyan and Andrew Zisserman · 2014
Earlier work this paper cites.
Tiny imagenet visual recognition challenge
Ya Le and Xuan Yang · 2015
Earlier work this paper cites.
Deep residual learning for image recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun · 2016
Earlier work this paper cites.
Direct feedback alignment provides learning in deep neural networks
Arild Nøkland · 2016
Earlier work this paper cites.
A baseline for detecting misclassified and out-of-distribution examples in neural networks
Dan Hendrycks and Kevin Gimpel · 2017
Earlier work this paper cites.
Decoupled weight decay regularization
Ilya Loshchilov and Frank Hutter · 2017
Earlier work this paper cites.
Equilibrium propagation: Bridging the gap between energy-based models and backpropagation
Benjamin Scellier and Yoshua Bengio · 2017
Cited alongside, same era.
A review of predictive coding algorithms
Michael W. Spratling · 2017
Cited alongside, same era.
An approximation of the error backpropagation algorithm in a predictive coding network with local Hebbian synaptic plasticity
James C. R. Whittington and Rafal Bogacz · 2017
Cited alongside, same era.
Fashion-MNIST: A novel image dataset for benchmarking machine learning algorithms
Han Xiao, Kashif Rasul, and Roland Vollgraf · 2017
Cited alongside, same era.
JAX: composable transformations of Python+NumPy programs, 2018
James Bradbury, Roy Frostig, Peter Hawkins, Matthew James Johnson, Chris Leary, Dougal Maclaurin, George Necula, Adam Paszke, Jake VanderPlas, Skye Wanderman-Milne, and Qiao Zhang · 2018
Cited alongside, same era.
Hebbian deep learning without feedback
Adrien Journé, Hector Garcia Rodriguez, Qinghai Guo, and Timoleon Moraitis · 2022
Later among the works it cites.
Holomorphic equilibrium propagation computes exact gradients through finite size oscillations
Axel Laborieux and Friedemann Zenke · 2022
Later among the works it cites.
SoftHebb: bayesian inference in unsupervised Hebbian soft winner-take-all networks
Timoleon Moraitis, Dmitry Toichkin, Adrien Journé, Yansong Chua, and Qinghai Guo · 2022
Later among the works it cites.
The neural coding framework for learning generative models
Alexander Ororbia and Daniel Kifer · 2022
Later among the works it cites.
Predictive coding beyond Gaussian distributions
Luca Pinchetti, Tommaso Salvatori, Beren Millidge, Yuhang Song, Yordan Yordanov, and Thomas Lukasiewicz · 2022
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Large-scale celebfaces attributes (celeba) dataset
Ziwei Liu, Ping Luo, Xiaogang Wang, and Xiaoou Tang · 2018
Cited alongside, same era.
The DeepMind JAX Ecosystem, 2020
DeepMind, Igor Babuschkin, Kate Baumli, Alison Bell, Surya Bhupatiraju, Jake Bruce, Peter Buchlovsky, David Budden, Trevor Cai, Aidan Clark, Ivo Danihelka, Antoine Dedieu, Claudio Fantacci, Jonathan Godwin, Chris Jones, Ross Hemsley, Tom Hennigan, Matteo Hessel, Shaobo Hou, Steven Kapturowski, Thomas Keck, Iurii Kemaev, Michael King, Markus Kunesch, Lena Martens, Hamza Merzic, Vladimir Mikulik, Tamara Norman, George Papamakarios, John Quan, Roman Ring, Francisco Ruiz, Alvaro Sanchez, Laurent Sartran, Rosalia Schneider, Eren Sezener, Stephen Spencer, Srivatsan Srinivasan, Miloš Stanojević, Wojciech Stokowiec, Luyu Wang, Guangyao Zhou, and Fabio Viola · 2020
Cited alongside, same era.
Your classifier is secretly an energy based model and you should treat it like one
Will Grathwohl, Kuan-Chieh Wang, Joern-Henrik Jacobsen, David Duvenaud, Mohammad Norouzi, and Kevin Swersky · 2020
Cited alongside, same era.
Direct feedback alignment scales to modern deep learning tasks and architectures
Julien Launay, Iacopo Poli, François Boniface, and Florent Krzakala · 2020
Cited alongside, same era.
Energy-based out-of-distribution detection
Weitang Liu, Xiaoyun Wang, John Owens, and Yixuan Li · 2020
Cited alongside, same era.
On Neural Differential Equations
Patrick Kidger · 2021
Cited alongside, same era.
Equinox: Neural networks in JAX via callable PyTrees and filtered transformations
Patrick Kidger and Cristian Garcia · 2021
Cited alongside, same era.
Tommaso Salvatori, Luca Pinchetti, Beren Millidge, Yuhang Song, Tianyi Bao, Rafal Bogacz, and Thomas Lukasiewicz · 2022
Later among the works it cites.
BayesPCN: a continually learnable predictive coding associative memory
Jinsoo Yoo and Frank Wood · 2022
Later among the works it cites.
Signal propagation: The framework for learning and inference in a forward pass
Adam Kohan, Edward A. Rietman, and Hava T. Siegelmann · 2023
Later among the works it cites.
Active predictive coding: Brain-inspired reinforcement learning for sparse reward robotic control problems
Alexander Ororbia and Ankur Mali · 2023
Later among the works it cites.
Backpropagation-free deep learning with recursive local representation alignment
Alexander G. Ororbia, Ankur Mali, Daniel Kifer, and C. Lee Giles · 2023
Later among the works it cites.
Recurrent predictive coding models for associative memory employing covariance learning
Mufeng Tang, Tommaso Salvatori, Beren Millidge, Yuhang Song, Thomas Lukasiewicz, and Rafal Bogacz · 2023
Later among the works it cites.
Learning probability distributions of sensory inputs with Monte Carlo predictive coding
Gaspard Oliviers, Rafal Bogacz, and Alexander Meulemans · 2024
Closest in time.
Incremental predictive coding: A parallel and fully automatic learning algorithm
Tommaso Salvatori, Yuhang Song, Beren Millidge, Zhenghua Xu, Lei Sha, Cornelius Emde, Rafal Bogacz, and Thomas Lukasiewicz · 2024
Closest in time.
Energy-based learning algorithms for analog computing: a comparative study
Benjamin Scellier, Maxence Ernoult, Jack Kendall, and Suhas Kumar · 2024
Closest in time.
Divide-and-conquer predictive coding: A structured Bayesian inference algorithm
Eli Sennesh, Hao Wu, and Tommaso Salvatori · 2024
Closest in time.
Prospective-configuration
Yuhang Song · 2024
Closest in time.
Inferring neural activity before plasticity as a foundation for learning beyond backpropagation
Yuhang Song, Beren Millidge, Tommaso Salvatori, Thomas Lukasiewicz, Zhenghua Xu, and Rafal Bogacz · 2024
Closest in time.
Sequential memory with temporal predictive coding
Mufeng Tang, Helen Barron, and Rafal Bogacz · 2024
Closest in time.