Fetching the paper…
Reading the bibliography…
An evolving area of research in deep learning is the study of architectures and inductive biases that support the learning of relational feature representations.
“Intermittent reinforcement of matching to sample in the pigeon”
Charles Ferster · 1960
Earlier work this paper cites.
“Unified tri-service cognitive performance assessment battery (UTC-PAB) I. Design and Specification of the Battery”
CE Englund, DL Reeves, CA Shingledecker, DR Thorne, KP Wilson and FW Hegge · 1987
Earlier work this paper cites.
“What one intelligence test measures: a theoretical account of the processing in the Raven Progressive Matrices Test.”
Patricia Carpenter, Marcel Just and Peter Shell · 1990
Earlier work this paper cites.
“Rule learning by seven-month-old infants”
Gary Marcus, Sugumaran Vijayan, Shoba Bandi and Peter Vishton · 1999
Earlier work this paper cites.
“Discriminating the relation between relations: the role of entropy in abstract conceptualization by baboons (Papio papio) and humans (Homo sapiens).”
Jo\"el Fagot, Edward Wasserman and Michael Young · 2001
Earlier work this paper cites.
“The descent of hierarchy, and selection in relational semantics”
Barbara Rosario, Marti Hearst and Charles Fillmore · 2002
Earlier work this paper cites.
“How hierarchical is language use?”
Stefan Frank, Rens Bod and Morten Christiansen · 2012
Earlier work this paper cites.
“Visualizing and understanding convolutional networks”
Matthew Zeiler and Rob Fergus · 2014
Earlier work this paper cites.
Jimmy Ba, Jamie Kiros and Geoffrey. Hinton · 2016
Earlier work this paper cites.
“Deep residual learning for image recognition”
Kaiming He, Xiangyu Zhang, Shaoqing Ren and Jian Sun · 2016
Earlier work this paper cites.
“Learning convolutional neural networks for graphs”
Mathias Niepert, Mohamed Ahmed and Konstantin Kutzkov · 2016
Earlier work this paper cites.
“Neural Message Passing for Quantum Chemistry”
Justin Gilmer, Samuel. Schoenholz, Patrick. Riley, Oriol Vinyals and George. Dahl · 2017
Earlier work this paper cites.
“Children’s representation of abstract relations in relational/array match-to-sample tasks”
Jean-R\’emy Hochmann, Arin. Tuerk, Sophia Sanborn, Rebecca Zhu, Robert Long, Megan Dempster and Susan Carey · 2017
Earlier work this paper cites.
“CLEVR: A diagnostic dataset for compositional language and elementary visual reasoning”
Justin Johnson, Bharath Hariharan, Laurens Van Der, Li Fei-Fei, C Lawrence and Ross Girshick · 2017
Earlier work this paper cites.
“Semi-Supervised Classification with Graph Convolutional Networks”
Thomas. Kipf and Max Welling · 2017
Cited alongside, same era.
“A regularized framework for sparse and structured neural attention”
Vlad Niculae and Mathieu Blondel · 2017
Cited alongside, same era.
“Dynamic routing between capsules”
Sara Sabour, Nicholas Frosst and Geoffrey Hinton · 2017
Cited alongside, same era.
“A simple neural network module for relational reasoning”
Adam Santoro, David Raposo, David Barrett, Mateusz Malinowski, Razvan Pascanu, Peter Battaglia and Timothy Lillicrap · 2017
Cited alongside, same era.
“Attention is all you need”
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan Gomez, ukasz Kaiser and Illia Polosukhin · 2017
Cited alongside, same era.
“Deep sets”
Manzil Zaheer, Satwik Kottur, Siamak Ravanbakhsh, Barnabas Poczos, Russ Salakhutdinov and Alexander Smola · 2017
Cited alongside, same era.
“Graph Representation Learning”, Synthesis Lectures on Artificial Intelligence and Machine Learning
William Hamilton · 2020
Later among the works it cites.
“Object-centric learning with slot attention”
Francesco Locatello, Dirk Weissenborn, Thomas Unterthiner, Aravindh Mahendran, Georg Heigold, Jakob Uszkoreit, Alexey Dosovitskiy and Thomas Kipf · 2020
Later among the works it cites.
“Sparse and continuous attention mechanisms”
Andr\’e Martins, Ant\’onio Farinhas, Marcos Treviso, Vlad Niculae, Pedro Aguiar and Mario Figueiredo · 2020
Later among the works it cites.
“An Explicitly Relational Neural Network Architecture”
Murray Shanahan, Kyriacos Nikiforou, Antonia Creswell, Christos Kaplanis, David Barrett and Marta Garnelo · 2020
Later among the works it cites.
“Learning Representations that Support Extrapolation”
Taylor Webb, Zachary Dulberg, Steven Frankland, Alexander Petrov, Randall O’Reilly and Jonathan Cohen · 2020
Later among the works it cites.
“Emergent Symbols through Binding in External Memory”
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
“Relational Inductive Biases, Deep Learning, and Graph Networks”
Peter. Battaglia et al · 2018
Cited alongside, same era.
“Neural relational inference for interacting systems”
Thomas Kipf, Ethan Fetaya, Kuan-Chieh Wang, Max Welling and Richard Zemel · 2018
Cited alongside, same era.
“Relational Recurrent Neural Networks”
Adam Santoro, Ryan Faulkner, David Raposo, Jack Rae, Mike Chrzanowski, Theophane Weber, Daan Wierstra, Oriol Vinyals, Razvan Pascanu and Timothy Lillicrap · 2018
Cited alongside, same era.
“Modeling relational data with graph convolutional networks”
Michael Schlichtkrull, Thomas Kipf, Peter Bloem, Rianne Van Den, Ivan Titov and Max Welling · 2018
Cited alongside, same era.
“Graph Attention Networks”
Petar Veličković, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Liò and Yoshua Bengio · 2018
Cited alongside, same era.
“Deep reinforcement learning with relational inductive biases”
Vinicius Zambaldi, David Raposo, Adam Santoro, Victor Bapst, Yujia Li, Igor Babuschkin, Karl Tuyls, David Reichert, Timothy Lillicrap and Edward Lockhart · 2018
Cited alongside, same era.
Taylor Webb, Ishan Sinha and Jonathan Cohen · 2021
Later among the works it cites.
“Entropy-based Attention Regularization Frees Unintended Bias Mitigation from Lists”
Giuseppe Attanasio, Debora Nozza, Dirk Hovy and Elena Baralis · 2022
Later among the works it cites.
“On Neural Architecture Inductive Biases for Relational Tasks”, 2022
Giancarlo Kerg, Sarthak Mittal, David Rolnick, Yoshua Bengio, Blake Richards and Guillaume Lajoie · 2022
Later among the works it cites.
“Conditional Object-Centric Learning from Video”
Thomas Kipf, Gamaleldin Elsayed, Aravindh Mahendran, Austin Stone, Sara Sabour, Georg Heigold, Rico Jonschkowski, Alexey Dosovitskiy and Klaus Greff · 2022
Later among the works it cites.
“Approximation of relation functions and attention mechanisms”, 2024
Awni Altabaa and John Lafferty · 2024
Closest in time.
Awni Altabaa and John Lafferty · 2024
Closest in time.
“Abstractors and relational cross-attention: An inductive bias for explicit relational reasoning in Transformers”
Awni Altabaa, Taylor Webb, Jonathan. Cohen and John Lafferty · 2024
Closest in time.
“The Relational Bottleneck as an Inductive Bias for Efficient Abstraction”
Taylor. Webb, Steven. Frankland, Awni Altabaa, Kamesh Krishnamurthy, Declan Campbell, Jacob Russin, Randall O’Reilly, John Lafferty and Jonathan. Cohen · 2024
Closest in time.