2021

HALMA: Humanlike Abstraction Learning Meets Affordance in Rapid Problem Solving

Xie, Sirui, Ma, Xiaojian, Yu, Peiyu et al.

Understand

Humans learn compositional and causal abstraction, \ie, knowledge, in response to the structure of naturalistic tasks.

When presented with a problem-solving task involving some objects, toddlers would first interact with these objects to reckon what they are and what can be done with them.
Leveraging these concepts, they could understand the internal structure of this task, without seeing all of the problem instances.
Remarkably, they further build cognitively executable strategies to \emph{rapidly} solve novel problems.

Built on

Word and object
Willard Van Orman Quine · 1960
Earlier work this paper cites.
The developmental psychology of Jean Piaget
John H Flavell · 1963
Earlier work this paper cites.
Strips: A new approach to the application of theorem proving to problem solving
Richard E Fikes and Nils J Nilsson · 1971
Earlier work this paper cites.
Vision: A Computational Investigation into the Human Representation and Processing of Visual Information
David Marr · 1982
Earlier work this paper cites.
Semantics and cognition , volume 8
Ray Jackendoff · 1983
Earlier work this paper cites.
The Ecological Approach to Visual Perception
James Jerome Gibson · 1986
Earlier work this paper cites.
Connectionism and cognitive architecture: A critical analysis
Jerry A Fodor, Zenon W Pylyshyn, et al · 1988
Earlier work this paper cites.
Finding structure in time
Jeffrey L Elman · 1990
Earlier work this paper cites.
Cross-linguistic regularities in the frequency of number words
Stanislas Dehaene and Jacques Mehler · 1992
Earlier work this paper cites.
The reviewing of object files: Object-specific integration of information
Daniel Kahneman, Anne Treisman, and Brian J Gibbs · 1992
Earlier work this paper cites.
General pattern theory: A mathematical study of regular structures Oxford mathematical monographs
Ulf Grenander · 1993
Earlier work this paper cites.
Mental leaps: Analogy in creative thought
Keith J Holyoak, Keith James Holyoak, and Paul Thagard · 1996
Earlier work this paper cites.
Simple principles of metalearning
Juergen Schmidhuber, Jieyu Zhao, and MA Wiering · 1996
Earlier work this paper cites.
Long short-term memory
Sepp Hochreiter and Jürgen Schmidhuber · 1997
Earlier work this paper cites.
Planning and acting in partially observable stochastic domains
Leslie Pack Kaelbling, Michael L Littman, and Anthony R Cassandra · 1998
Earlier work this paper cites.
Between mdps and semi-mdps: A framework for temporal abstraction in reinforcement learning
Richard S Sutton, Doina Precup, and Satinder Singh · 1999
Earlier work this paper cites.
Tracking individuals via object-files: evidence from infants’ manual search
Lisa Feigenson and Susan Carey · 2003
Earlier work this paper cites.
Prefrontal cortex and flexible cognitive control: Rules without symbols
Nicolas P Rougier, David C Noelle, Todd S Braver, Jonathan D Cohen, and Randall C O’Reilly · 2005
Earlier work this paper cites.
Towards a unified theory of state abstraction for mdps
Lihong Li, Thomas J Walsh, and Michael L Littman · 2006
Earlier work this paper cites.
A stochastic grammar of images
Song-Chun Zhu and David Mumford · 2007
Earlier work this paper cites.
A rational analysis of rule-based concept learning
Noah D Goodman, Joshua B Tenenbaum, Jacob Feldman, and Thomas L Griffiths · 2008
Earlier work this paper cites.
Learning object affordances: from sensory–motor coordination to imitation
Luis Montesano, Manuel Lopes, Alexandre Bernardino, and José Santos-Victor · 2008
Earlier work this paper cites.
First-order decision-theoretic planning in structured relational environments
Scott Patrick Sanner · 2008
Earlier work this paper cites.
The origin of concepts
Susan Carey · 2009
Earlier work this paper cites.

Similar

The number sense: How the mind creates mathematics
Stanislas Dehaene · 2011
Cited alongside, same era.
Bisimulation metrics for continuous markov decision processes
Norm Ferns, Prakash Panangaden, and Doina Precup · 2011
Cited alongside, same era.
Scikit-learn: Machine learning in Python
F. Pedregosa, G. Varoquaux, A. Gramfort, V. Michel, B. Thirion, O. Grisel, M. Blondel, P. Prettenhofer, R. Weiss, V. Dubourg, J. Vanderplas, A. Passos, D. Cournapeau, M. Brucher, M. Perrot, and E. Duchesnay · 2011
Cited alongside, same era.
Cliff or step? posture-specific learning at the edge of a drop-off
Kari S Kretch and Karen E Adolph · 2013
Cited alongside, same era.
The computational and neural basis of cognitive control: charted territory and new frontiers
Matthew M Botvinick and Jonathan D Cohen · 2014
Cited alongside, same era.
Empirical evaluation of gated recurrent neural networks on sequence modeling
Original
Junyoung Chung, Caglar Gulcehre, KyungHyun Cho, and Yoshua Bengio · 2014
Cited alongside, same era.
Adam: A method for stochastic optimization
Original
Diederik P Kingma and Jimmy Ba · 2014
Cited alongside, same era.
Human-level concept learning through probabilistic program induction
Brenden M Lake, Ruslan Salakhutdinov, and Joshua B Tenenbaum · 2015
Cited alongside, same era.
Understanding tools: Task-oriented object modeling, learning and recognition
Yixin Zhu, Yibiao Zhao, and Song-Chun Zhu · 2015
Cited alongside, same era.
Layer normalization
Original
Jimmy Lei Ba, Jamie Ryan Kiros, and Geoffrey E Hinton · 2016
Cited alongside, same era.
Attend, infer, repeat: Fast scene understanding with generative models
SM Ali Eslami, Nicolas Heess, Theophane Weber, Yuval Tassa, David Szepesvari, Geoffrey E Hinton, et al · 2016
Cited alongside, same era.
Value iteration networks
Aviv Tamar, Yi Wu, Garrett Thomas, Sergey Levine, and Pieter Abbeel · 2016
Cited alongside, same era.

Then

Emergence of linguistic communication from referential games with symbolic and pixel input
Angeliki Lazaridou, Karl Moritz Hermann, Karl Tuyls, and Stephen Clark · 2018
Later among the works it cites.
The algebraic mind: Integrating connectionism and cognitive science
Gary F Marcus · 2018
Later among the works it cites.
Emergence of grounded compositional language in multi-agent populations
Igor Mordatch and Pieter Abbeel · 2018
Later among the works it cites.
Been there, done that: Meta-learning with episodic recall
Samuel Ritter, Jane Wang, Zeb Kurth-Nelson, Siddhant Jayakumar, Charles Blundell, Razvan Pascanu, and Matthew Botvinick · 2018
Later among the works it cites.
Prefrontal cortex as a meta-reinforcement learning system
Jane X Wang, Zeb Kurth-Nelson, Dharshan Kumaran, Dhruva Tirumala, Hubert Soyer, Joel Z Leibo, Demis Hassabis, and Matthew Botvinick · 2018
Later among the works it cites.
Unsupervised predictive memory in a goal-directed agent
Original
Greg Wayne, Chia-Chun Hung, David Amos, Mehdi Mirza, Arun Ahuja, Agnieszka Grabska-Barwinska, Jack Rae, Piotr Mirowski, Joel Z Leibo, Adam Santoro, et al · 2018
Later among the works it cites.
Systematic generalization: What is required and can it be learned?
Dzmitry Bahdanau, Shikhar Murty, Michael Noukhovitch, Thien Huu Nguyen, Harm de Vries, and Aaron Courville · 2019
Later among the works it cites.
Monet: Unsupervised scene decomposition and representation
Original
Christopher P Burgess, Loic Matthey, Nicholas Watters, Rishabh Kabra, Irina Higgins, Matt Botvinick, and Alexander Lerchner · 2019
Later among the works it cites.
Quantifying generalization in reinforcement learning
Karl Cobbe, Oleg Klimov, Chris Hesse, Taehoon Kim, and John Schulman · 2019
Later among the works it cites.
Deepmdp: Learning continuous latent space models for representation learning
Carles Gelada, Saurabh Kumar, Jacob Buckman, Ofir Nachum, and Marc G Bellemare · 2019
Later among the works it cites.
Multi-object representation learning with iterative variational inference
Klaus Greff, Raphaël Lopez Kaufman, Rishabh Kabra, Nick Watters, Christopher Burgess, Daniel Zoran, Loic Matthey, Matthew Botvinick, and Alexander Lerchner · 2019
Later among the works it cites.
An investigation of model-free planning
Arthur Guez, Mehdi Mirza, Karol Gregor, Rishabh Kabra, Sebastien Racaniere, Theophane Weber, David Raposo, Adam Santoro, Laurent Orseau, Tom Eccles, et al · 2019
Later among the works it cites.
Challenging common assumptions in the unsupervised learning of disentangled representations
Francesco Locatello, Stefan Bauer, Mario Lucic, Gunnar Raetsch, Sylvain Gelly, Bernhard Schölkopf, and Olivier Bachem · 2019
Later among the works it cites.
Habitat: A platform for embodied ai research
Manolis Savva, Abhishek Kadian, Oleksandr Maksymets, Yili Zhao, Erik Wijmans, Bhavana Jain, Julian Straub, Jia Liu, Vladlen Koltun, Jitendra Malik, et al · 2019
Later among the works it cites.
Visual semantic navigation using scene priors
Wei Yang, Xiaolong Wang, Ali Farhadi, Abhinav Gupta, and Roozbeh Mottaghi · 2019
Later among the works it cites.
Deep reinforcement learning with relational inductive biases
Vinicius Zambaldi, David Raposo, Adam Santoro, Victor Bapst, Yujia Li, Igor Babuschkin, Karl Tuyls, David Reichert, Timothy Lillicrap, Edward Lockhart, et al · 2019
Later among the works it cites.
Raven: A dataset for relational and analogical visual reasoning
Chi Zhang, Feng Gao, Baoxiong Jia, Yixin Zhu, and Song-Chun Zhu · 2019
Later among the works it cites.
Embodied multimodal multitask learning
Devendra Singh Chaplot, Lisa Lee, Ruslan Salakhutdinov, Devi Parikh, and Dhruv Batra · 2020
Later among the works it cites.
What can i do here? a theory of affordances in reinforcement learning
Khimya Khetarpal, Zafarali Ahmed, Gheorghe Comanici, David Abel, and Doina Precup · 2020
Later among the works it cites.
Space: Unsupervised object-oriented scene representation via spatial attention and decomposition
Zhixuan Lin, Yi-Fu Wu, Skand Vishwanath Peri, Weihao Sun, Gautam Singh, Fei Deng, Jindong Jiang, and Sungjin Ahn · 2020
Later among the works it cites.
Dd-ppo: Learning near-perfect pointgoal navigators from 2.5 billion frames
Erik Wijmans, Abhishek Kadian, Ari Morcos, Stefan Lee, Irfan Essa, Devi Parikh, Manolis Savva, and Dhruv Batra · 2020
Later among the works it cites.
Learning invariant representations for reinforcement learning without reconstruction
Original
Amy Zhang, Rowan McAllister, Roberto Calandra, Yarin Gal, and Sergey Levine · 2020
Later among the works it cites.
Dark, beyond deep: A paradigm shift to cognitive ai with humanlike common sense
Yixin Zhu, Tao Gao, Lifeng Fan, Siyuan Huang, Mark Edmonds, Hangxin Liu, Feng Gao, Chi Zhang, Siyuan Qi, Ying Nian Wu, Josh B Tenenbaum, and Song-Chun Zhu · 2020
Later among the works it cites.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Reading the bibliography…