Fetching the paper…
Reading the bibliography…
Many deep neural network architectures loosely based on brain networks have recently been shown to replicate neural firing patterns observed in the brain.
R-Transformer: Recurrent Neural Network Enhanced Transformer
Zhiwei Wang, Yao Ma, Zitao Liu, and Jiliang Tang · 1907
Earlier work this paper cites.
The hippocampus as a spatial map. Preliminary evidence from unit activity in the freely-moving rat
John O’Keefe and J. Dostrovsky · 1971
Earlier work this paper cites.
Neural networks and physical systems with emergent collective computational abilities (associative memory/parallel processing/categorization/content-addressable memory/fail-soft devices)
J J Hopfield · 1982
Earlier work this paper cites.
Storing infinite numbers of patterns in a spin-glass model of neural networks
Daniel J. Amit, Hanoch Gutfreund, and H. Sompolinsky · 1985
Earlier work this paper cites.
Gradient-based learning applied to document recognition
Yann Lecun, Le’on Bottou, Yoshua Bengio, and Parick Haffner · 1998
Earlier work this paper cites.
Microstructure of a spatial map in the entorhinal cortex
Torkel Hafting, Marianne Fyhn, Sturla Molden, May-britt Britt Moser, and Edvard I. Moser · 2005
Earlier work this paper cites.
The hippocampal indexing theory and episodic memory: Updating the index
Timothy J Teyler and Jerry W Rudy · 2007
Earlier work this paper cites.
Large Associative Memory Problem in Neurobiology and Machine Learning
Dmitry Krotov and John Hopfield · 2008
Earlier work this paper cites.
Accurate path integration in continuous attractor network models of grid cells
Yoram Burak and Ila R. Fiete · 2009
Earlier work this paper cites.
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn, Xiaohua Zhai, Thomas Unterthiner, Mostafa Dehghani, Matthias Minderer, Georg Heigold, Sylvain Gelly, Jakob Uszkoreit, and Neil Houlsby · 2010
Earlier work this paper cites.
Grid Cells, Place Cells, and Geodesic Generalization for Spatial Reinforcement Learning
Nicholas J. Gustafson and Nathaniel D. Daw · 2011
Earlier work this paper cites.
Neural Representations of Location Composed of Spatially Periodic Bands
Julia Krupic, Neil Burgess, and John O’Keefe · 2012
Earlier work this paper cites.
Deep Supervised, but Not Unsupervised, Models May Explain IT Cortical Representation
Seyed Mahdi Khaligh-Razavi and Nikolaus Kriegeskorte · 2014
Cited alongside, same era.
ImageNet Classification with Deep Convolutional Neural Networks
Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton · 2014
Cited alongside, same era.
Hippocampal representation of related and opposing memories develop within distinct, hierarchically organized neural schemas
Sam McKenzie, Andrea J. Frank, Nathaniel R. Kinsky, Blake Porter, Pamela D Rivie, Pamela D. Rivière, Howard Eichenbaum, Pamela D Rivie, Pamela D. Rivière, Howard Eichenbaum, Pamela D Rivie, Pamela D. Rivière, and Howard Eichenbaum · 2014
Cited alongside, same era.
Performance-optimized hierarchical models predict neural responses in higher visual cortex
Daniel L K Yamins, Ha Hong, Charles F. Cadieu, Ethan A. Solomon, Darren Seibert, and James J. DiCarlo · 2014
Cited alongside, same era.
Extracting grid cell characteristics from place cell inputs using non-negative principal component analysis
Yedidyah Dordek, Daniel Soudry, Ron Meir, and Dori Derdikman · 2016
Semantic memory in developmental amnesia
Rachael L. Elward and Faraneh Vargha-Khadem · 2018
Later among the works it cites.
A Framework for Intelligence and Cortical Function Based on Grid Cells in the Neocortex
Jeff Hawkins, Marcus Lewis, Mirko Klukas, Scott Purdy, and Subutai Ahmad · 2018
Later among the works it cites.
A unified theory for the origin of grid cells through the lens of pattern formation
Ben Sorscher, Gabriel C Mel, Surya Ganguli, and Samuel A Ocko · 2019
Later among the works it cites.
Language models are few-shot learners
Tom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel M. Ziegler, Jeffrey Wu, Clemens Winter, Christopher Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei · 2020
Later among the works it cites.
Learning to encode position for transformer with continuous dynamical model
Xuanqing Liu, Hsiang Fu Yu, Inderjit S. Dhillon, and Cho Jui Hsieh · 2020
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
Deep Residual Learning for Image Recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun · 2016
Cited alongside, same era.
Dense Associative Memory for Pattern Recognition
Dmitry Krotov and John J. Hopfield · 2016
Cited alongside, same era.
On a Model of Associative Memory with Huge Storage Capacity
Mete Demircigil, Judith Heusel, Matthias Löwe, Sven Upgang, and Franck Vermet · 2017
Cited alongside, same era.
The hippocampus as a predictive map
Kimberley L. Kimberly L. Kimberley L. Kimberly L. Stachenfeld, Matthew M. Botvinick, and Samuel J. Gershman · 2017
Cited alongside, same era.
Attention is all you need
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Łukasz Kaiser, and Illia Polosukhin · 2017
Cited alongside, same era.
Vector-based navigation using grid-like representations in artificial agents
Andrea Banino, Caswell Barry, Benigno Uria, Charles Blundell, Timothy Lillicrap, Piotr Mirowski, Alexander Pritzel, Martin J Chadwick, Thomas Degris, Joseph Modayil, Greg Wayne, Hubert Soyer, Fabio Viola, Brian Zhang, Ross Goroshin, Neil Rabinowitz, Razvan Pascanu, Charlie Beattie, Stig Petersen, Amir Sadik, Stephen Gaffney, Helen King, Koray Kavukcuoglu, Demis Hassabis, Raia Hadsell, and Dharshan Kumaran · 2018
Cited alongside, same era.
Christopher J. Cueva and Xue-Xin Wei · 2018
Cited alongside, same era.
Later among the works it cites.
Hopfield networks is all you need
Hubert Ramsauer, Bernhard Schäfl, Johannes Lehner, Philipp Seidl, Michael Widrich, Lukas Gruber, Markus Holzleitner, Milena Pavlović, Geir Kjetil Sandve, Victor Greiff, David Kreil, Michael Kopp, Günter Klambauer, Johannes Brandstetter, and Sepp Hochreiter · 2020
Later among the works it cites.
Efficient Inference in Structured Spaces
Honi Sanders, Matthew Wilson, Mirko Klukas, Sugandha Sharma, and Ila Fiete · 2020
Later among the works it cites.
The neural architecture of language: Integrative reverse-engineering converges on a model for predictive processing
Martin Schrimpf, Idan Blank, Greta Tuckute, Carina Kauf, Eghbal Hosseini, Nancy Kanwisher, Joshua Tenenbaum, and Evelina Fedorenko · 2020
Later among the works it cites.
The spatial memory pipeline: A model of egocentric to allocentric understanding in mammalian brains
Benigno Uria, Borja Ibarz, Andrea Banino, Vinicius Zambaldi, Dharshan Kumaran, Demis Hassabis, Caswell Barry, and Charles Blundell · 2020
Later among the works it cites.
The Tolman-Eichenbaum Machine: Unifying Space and Relational Memory through Generalization in the Hippocampal Formation
James CR R. Whittington, Timothy H. Muller, Shirley Mark, Caswell Barry, Neil Burgess, Timothy E.J. EJ Behrens, Guifen Chen, Caswell Barry, Neil Burgess, and Timothy E.J. EJ Behrens · 2020
Later among the works it cites.
Hippocampal Spatial Mapping As Fast Graph Learning
Marcus Lewis · 2021
Closest in time.
Clone-structured graph representations enable flexible learning and vicarious evaluation of cognitive maps
Dileep George, Rajeev V. Rikhye, Nishad Gothoskar, J. Swaroop Guntupalli, Antoine Dedieu, and Miguel Lázaro-Gredilla · 2041
Closest in time.