Fetching the paper…
Reading the bibliography…
It has long been known in both neuroscience and AI that ``binding'' between neurons leads to a form of competitive learning where representations are compressed in order to represent more abstract concepts in deeper layers of the network.
The integrative action of the nervous system
Charles Scott Sherrington · 1906
Earlier work this paper cites.
A logical calculus of the ideas immanent in nervous activity
Warren S McCulloch and Walter Pitts · 1943
Earlier work this paper cites.
Receptive fields, binocular interaction and functional architecture in the cat’s visual cortex
David H Hubel and Torsten N Wiesel · 1962
Earlier work this paper cites.
Competition and cooperation in neural nets
Shun-Ichi Amari and Michael A Arbib · 1977
Earlier work this paper cites.
Neural networks and physical systems with emergent collective computational abilities
John J Hopfield · 1982
Earlier work this paper cites.
Chemical turbulence
Yoshiki Kuramoto · 1984
Earlier work this paper cites.
Zur theorie des ferromagnetismus
Werner Heisenberg · 1985
Earlier work this paper cites.
Oscillatory responses in cat visual cortex exhibit inter-columnar synchronization which reflects global stimulus properties
Charles M Gray, Peter König, Andreas K Engel, and Wolf Singer · 1989
Earlier work this paper cites.
Contrastive learning and neural oscillations
Pierre Baldi and Fernando Pineda · 1991
Earlier work this paper cites.
Learning to segment images using dynamic feature binding
Michael C Mozer, Richard Zemel, and Marlene Behrmann · 1991
Earlier work this paper cites.
Network of neural oscillators for retrieving phase information
Toshio Aoyagi · 1995
Earlier work this paper cites.
An emergent model of orientation selectivity in cat visual cortical simple cells
David C Somers, Sacha B Nelson, and Mriganka Sur · 1995
Earlier work this paper cites.
The columnar organization of the neocortex
Vernon B Mountcastle · 1997
Earlier work this paper cites.
Image segmentation based on oscillatory correlation
Deliang Wang and James T. Terman · 1997
Earlier work this paper cites.
On discriminative vs. generative classifiers: A comparison of logistic regression and naive bayes
Andrew Ng and Michael Jordan · 2001
Earlier work this paper cites.
Pattern recognition and machine learning , volume 4
Christopher M Bishop and Nasser M Nasrabadi · 2006
Earlier work this paper cites.
Swarms on sphere: A programmable swarm with synchronous behaviors like oscillator networks
Reza Olfati-Saber · 2006
Earlier work this paper cites.
Propagating waves mediate information transfer in the motor cortex
Doug Rubino, Kay A Robbins, and Nicholas G Hatsopoulos · 2006
Earlier work this paper cites.
Hippocampal theta oscillations are travelling waves
Evgueniy V Lubenov and Athanassios G Siapas · 2009
Earlier work this paper cites.
Generative models of cortical oscillations: neurobiological implications of the kuramoto model
Michael Breakspear, Stewart Heitmann, and Andreas Daffertshofer · 2010
Earlier work this paper cites.
The pascal visual object classes (voc) challenge
Mark Everingham, Luc Van Gool, Christopher KI Williams, John Winn, and Andrew Zisserman · 2010
Earlier work this paper cites.
The role of phase synchronization in memory processes
Juergen Fell and Nikolai Axmacher · 2011
Earlier work this paper cites.
Learning a generative model of images by factoring appearance and shape
Nicolas Le Roux, Nicolas Heess, Jamie Shotton, and John Winn · 2011
Earlier work this paper cites.
A computational role for bistability and traveling waves in motor cortex
Stewart Heitmann, Pulin Gong, and Michael Breakspear · 2012
Earlier work this paper cites.
Imagenet classification with deep convolutional neural networks
Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton · 2012
Earlier work this paper cites.
The theory of magnetism I: Statics and Dynamics , volume 17
Daniel C Mattis · 2012
Earlier work this paper cites.
Theta coordinated error-driven learning in the hippocampus
Nicholas Ketz, Srinimisha G. Morkonda, and Randall C. O’Reilly · 2013
Earlier work this paper cites.
Neuronal synchrony in complex-valued deep networks
David P Reichert and Thomas Serre · 2013
Earlier work this paper cites.
Synchronization of kuramoto model in a high-dimensional linear space
Jiandong Zhu · 2013
Earlier work this paper cites.
Neural machine translation by jointly learning to align and translate
Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio · 2014
Earlier work this paper cites.
Explaining and harnessing adversarial examples
Ian J Goodfellow, Jonathon Shlens, and Christian Szegedy · 2014
Earlier work this paper cites.
Microsoft coco: Common objects in context
Tsung-Yi Lin, Michael Maire, Serge Belongie, James Hays, Pietro Perona, Deva Ramanan, Piotr Dollár, and C Lawrence Zitnick · 2014
Earlier work this paper cites.
Intriguing properties of neural networks
Christian Szegedy, Wojciech Zaremba, Ilya Sutskever, Joan Bruna, Dumitru Erhan, Ian J. Goodfellow, and Rob Fergus · 2014
Earlier work this paper cites.
Batch normalization: Accelerating deep network training by reducing internal covariate shift
Sergey Ioffe and Christian Szegedy · 2015
Earlier work this paper cites.
Adam: A method for stochastic optimization
Diederik Kingma and Jimmy Ba · 2015
Earlier work this paper cites.
Tiny imagenet visual recognition challenge
Ya Le and Xuan Yang · 2015
Earlier work this paper cites.
Layer normalization
Jimmy Lei Ba, Jamie Ryan Kiros, and Geoffrey E Hinton · 2016
Earlier work this paper cites.
Identity mappings in deep residual networks
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun · 2016
Earlier work this paper cites.
Rotating waves during human sleep spindles organize global patterns of activity that repeat precisely through the night
Lyle Muller, Giovanni Piantoni, Dominik Koller, Sydney S Cash, Eric Halgren, and Terrence J Sejnowski · 2016
Earlier work this paper cites.
Phased lstm: Accelerating recurrent network training for long or event-based sequences
Daniel Neil, Michael Pfeiffer, and Shih-Chii Liu · 2016
Earlier work this paper cites.
Training confidence-calibrated classifiers for detecting out-of-distribution samples
Kimin Lee, Honglak Lee, Kibok Lee, and Jinwoo Shin · 2017
Earlier work this paper cites.
Towards deep learning models resistant to adversarial attacks
Aleksander Madry, Aleksandar Makelov, Ludwig Schmidt, Dimitris Tsipras, and Adrian Vladu · 2017
Cited alongside, same era.
Attention is all you need
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin · 2017
Cited alongside, same era.
Oscillator-based ising machine
Tianshi Wang and Jaijeet Roychowdhury · 2017
Cited alongside, same era.
Obfuscated gradients give a false sense of security: Circumventing defenses to adversarial examples
Anish Athalye, Nicholas Carlini, and David Wagner · 2018
Cited alongside, same era.
Virtual adversarial training: a regularization method for supervised and semi-supervised learning
Takeru Miyato, Shin-ichi Maeda, Masanori Koyama, and Shin Ishii · 2018
Cited alongside, same era.
Cortical travelling waves: mechanisms and computational principles
End-to-end algorithm synthesis with recurrent networks: Extrapolation without overthinking
Arpit Bansal, Avi Schwarzschild, Eitan Borgnia, Zeyad Emam, Furong Huang, Micah Goldblum, and Tom Goldstein · 2022
Later among the works it cites.
Object representations as fixed points: Training iterative refinement algorithms with implicit differentiation
Michael Chang, Tom Griffiths, and Sergey Levine · 2022
Later among the works it cites.
Learning iterative reasoning through energy minimization
Yilun Du, Shuang Li, Joshua Tenenbaum, and Igor Mordatch · 2022
Later among the works it cites.
The functional role of oscillatory dynamics in neocortical circuits: a computational perspective
Felix Effenberger, Pedro Carvalho, Igor Dubinin, and Wolf Singer · 2022
Later among the works it cites.
Masked autoencoders are scalable vision learners
Kaiming He, Xinlei Chen, Saining Xie, Yanghao Li, Piotr Dollár, and Ross Girshick · 2022
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Lyle Muller, Frédéric Chavane, John Reynolds, and Terrence J Sejnowski · 2018
Cited alongside, same era.
Recurrent relational networks
Rasmus Palm, Ulrich Paquet, and Ole Winther · 2018
Cited alongside, same era.
Group normalization
Yuxin Wu and Kaiming He · 2018
Cited alongside, same era.
Theta and alpha oscillations are traveling waves in the human neocortex
Honghui Zhang, Andrew J Watrous, Ansh Patel, and Joshua Jacobs · 2018
Cited alongside, same era.
MONet: Unsupervised scene decomposition and representation
Christopher P Burgess, Loic Matthey, Nicholas Watters, Rishabh Kabra, Irina Higgins, Matt Botvinick, and Alexander Lerchner · 2019
Cited alongside, same era.
Continuous versus discontinuous transitions in the d-dimensional generalized kuramoto model: Odd d is different
Sarthak Chandra, Michelle Girvan, and Edward Ott · 2019
Cited alongside, same era.
Multi-object representation learning with iterative variational inference
Klaus Greff, Raphaël Lopez Kaufman, Rishabh Kabra, Nick Watters, Christopher Burgess, Daniel Zoran, Loic Matthey, Matthew Botvinick, and Alexander Lerchner · 2019
Cited alongside, same era.
On the effectiveness of adversarial training against common corruptions
Klim Kireev, Maksym Andriushchenko, and Nicolas Flammarion · 2022
Later among the works it cites.
Holomorphic equilibrium propagation computes exact gradients through finite size oscillations
Axel Laborieux and Friedemann Zenke · 2022
Later among the works it cites.
Complex-valued autoencoders for object discovery
Sindy Löwe, Phillip Lippe, Maja Rudolph, and Max Welling · 2022
Later among the works it cites.
Graph-coupled oscillator networks
T Konstantin Rusch, Ben Chamberlain, James Rowbottom, Siddhartha Mishra, and Michael Bronstein · 2022
Later among the works it cites.
Simple unsupervised object-centric learning for complex and naturalistic videos
Gautam Singh, Yi-Fu Wu, and Sungjin Ahn · 2022
Later among the works it cites.
Waves traveling over a map of visual space can ignite short-term predictions of sensory input
Gabriel B Benigno, Roberto C Budzinski, Zachary W Davis, John H Reynolds, and Lyle Muller · 2023
Later among the works it cites.
Invariant slot attention: Object discovery with slot-centric reference frames
Ondrej Biza, Sjoerd Van Steenkiste, Mehdi SM Sajjadi, Gamaleldin F Elsayed, Aravindh Mahendran, and Thomas Kipf · 2023
Later among the works it cites.
Energy transformer
Benjamin Hoover, Yuchen Liang, Bao Pham, Rameswar Panda, Hendrik Strobelt, Duen Horng Chau, Mohammed Zaki, and Dmitry Krotov · 2023
Later among the works it cites.
Improving object-centric learning with query optimization
Baoxiong Jia, Yu Liu, and Siyuan Huang · 2023
Later among the works it cites.
Object-centric slot diffusion
Jindong Jiang, Fei Deng, Gautam Singh, and Sungjin Ahn · 2023
Later among the works it cites.
Your diffusion model is secretly a zero-shot classifier
Alexander C Li, Mihir Prabhudesai, Shivam Duggal, Ellis Brown, and Deepak Pathak · 2023
Later among the works it cites.
Image segmentation with traveling waves in an exactly solvable recurrent neural network
Luisa HB Liboni, Roberto C Budzinski, Alexandra N Busch, Sindy Löwe, Thomas A Keller, Max Welling, and Lyle E Muller · 2023
Later among the works it cites.
Rotating features for object discovery
Sindy Löwe, Phillip Lippe, Francesco Locatello, and Max Welling · 2023
Later among the works it cites.
Unsupervised multi-object segmentation using attention and soft-argmax
Bruno Sauvalle and Arnaud de La Fortelle · 2023
Later among the works it cites.
Bridging the gap to real-world object-centric learning
Maximilian Seitzer, Max Horn, Andrii Zadaianchuk, Dominik Zietlow, Tianjun Xiao, Carl-Johann Simon-Gabriel, Tong He, Zheng Zhang, Bernhard Schölkopf, Thomas Brox, et al · 2023
Later among the works it cites.
Contrastive training of complex-valued autoencoders for object discovery
Aleksandar Stanić, Anand Gopalakrishnan, Kazuki Irie, and Jürgen Schmidhuber · 2023
Later among the works it cites.
Slotdiffusion: Object-centric generative modeling with diffusion models
Ziyi Wu, Jingyu Hu, Wuyue Lu, Igor Gilitschenski, and Animesh Garg · 2023
Later among the works it cites.
Learning to solve constraint satisfaction problems with recurrent transformer
Zhun Yang, Adam Ishay, and Joohyung Lee · 2023
Later among the works it cites.
Gust: combinatorial generalization by unsupervised grouping with neuronal coherence
Hao Zheng, Hui Lin, and Rong Zhao · 2023
Later among the works it cites.
Adversarial robustness limits via scaling-law and human-alignment studies
Brian R Bartoldson, James Diffenderfer, Konstantinos Parasyris, and Bhavya Kailkhura · 2024
Closest in time.
Transformers meet neural algorithmic reasoners
Wilfried Bounsi, Borja Ibarz, Andrew Dudzik, Jessica B Hamrick, Larisa Markeeva, Alex Vitvitskyi, Razvan Pascanu, and Petar Veličković · 2024
Closest in time.
Neural slot interpreters: Grounding object semantics in emergent slot representations
Bhishma Dedhia and Niraj K Jha · 2024
Closest in time.
Learning iterative reasoning through energy diffusion
Yilun Du, Jiayuan Mao, and Joshua B Tenenbaum · 2024
Closest in time.
Faith and fate: Limits of transformers on compositionality
Nouha Dziri, Ximing Lu, Melanie Sclar, Xiang Lorraine Li, Liwei Jiang, Bill Yuchen Lin, Sean Welleck, Peter West, Chandra Bhagavatula, Ronan Le Bras, et al · 2024
Closest in time.
The emergence of clusters in self-attention dynamics
Borjan Geshkovski, Cyril Letrouit, Yury Polyanskiy, and Philippe Rigollet · 2024
Closest in time.
Recurrent complex-weighted autoencoders for unsupervised object discovery
Anand Gopalakrishnan, Aleksandar Stanić, Jürgen Schmidhuber, and Michael Curtis Mozer · 2024
Closest in time.
Intriguing properties of generative classifiers
Priyank Jaini, Kevin Clark, and Robert Geirhos · 2024
Closest in time.
Learning to compose: Improving object centric learning by injecting compositionality
Whie Jung, Jaehoon Yoo, Sungjin Ahn, and Seunghoon Hong · 2024
Closest in time.
Spot: Self-training with patch-order permutation for object-centric learning with autoregressive transformers
Ioannis Kakogeorgiou, Spyros Gidaris, Konstantinos Karantzalos, and Nikos Komodakis · 2024
Closest in time.
A spacetime perspective on dynamical computation in neural information processing systems
T Anderson Keller, Lyle Muller, Terrence J Sejnowski, and Max Welling · 2024
Closest in time.
Binding Dynamics in Rotating Features
Sindy Löwe, Francesco Locatello, and Max Welling · 2024
Closest in time.
Gta: A geometry-aware attention mechanism for multi-view transformers
Takeru Miyato, Bernhard Jaeger, Max Welling, and Andreas Geiger · 2024
Closest in time.
From coupled oscillators to graph neural networks: Reducing over-smoothing via a kuramoto model-based approach
Tuan Nguyen, Hirotada Honda, Takashi Sano, Vinh Nguyen, Shugo Nakamura, and Tan Minh Nguyen · 2024
Closest in time.
Oscillations in an artificial neural network convert competing inputs into a temporal code
Marcel van Gerven and Ole Jensen · 2024
Closest in time.
Scaling up test-time compute with latent reasoning: A recurrent depth approach
Jonas Geiping, Sean McLeish, Neel Jain, John Kirchenbauer, Siddharth Singh, Brian R. Bartoldson, Bhavya Kailkhura, Abhinav Bhatele, and Tom Goldstein · 2025
Closest in time.