Fetching the paper…
Reading the bibliography…
People can learn a new concept and use it compositionally, understanding how to "blicket twice" after learning how to "blicket." In contrast, powerful sequence-to-sequence (seq2seq) neural networks fail such tests of compositionality, especially when composing new concepts together with existing concepts.
Compositional generalization in a deep seq2seq model by separating syntax and semantics
Jake Russin, Jason Jo, Randall C. O’Reilly, and Yoshua Bengio · 1904
Earlier work this paper cites.
Google’s neural machine translation system: Bridging the gap between human and machine translation
Yonghui Wu, Mike Schuster, Zhifeng Chen, Quoc Le, Mohammad Norouzi, Wolfgang Macherey, Maxim Krikun, Yuan Cao, Qin Gao, Klaus Macherey, Jeff Klingner, Apurva Shah, Melvin Johnson, Xiaobing Liu, Lukasz Kaiser, Stephan Gouws, Yoshikiyo Kato, Taku Kudo, Hideto Kazawa, Keith Stevens, George Kurian, Nishant Patil, Wei Wang, Cliff Young, Jason Smith, Jason Riesa, Alex Rudnick, Oriol Vinyals, Greg Corrado, Macduff Hughes, and Jeffrey Dean · 1906
Earlier work this paper cites.
Syntactic Structures
Noam Chomsky · 1957
Earlier work this paper cites.
Universal Grammar
Richard Montague · 1970
Earlier work this paper cites.
Connectionism and cognitive architecture: A critical analysis
Jerry Fodor and Zenon Pylyshyn · 1988
Earlier work this paper cites.
Children’s Use of Mutual Exclusivity to Constrain the Meanings of Words
Ellen M Markman and Gwyn F Wachtel · 1988
Earlier work this paper cites.
Long short-term memory
S Hochreiter and J Schmidhuber · 1997
Earlier work this paper cites.
Rethinking Eliminative Connectionism
Gary F Marcus · 1998
Earlier work this paper cites.
The Algebraic Mind: Integrating Connectionism and Cognitive Science
Gary F Marcus · 2003
Earlier work this paper cites.
Efficient Gradient-Based Inference through Transformations between Bayes Nets and Neural Nets
Diederik P Kingma and Max Welling · 2014
Earlier work this paper cites.
Sequence to Sequence Learning with Neural Networks
Ilya Sutskever, Oriol Vinyals, and Quoc V Le · 2014
Earlier work this paper cites.
Phrase similarity in humans and machines
Samuel J Gershman and Joshua B Tenenbaum · 2015
Earlier work this paper cites.
Learning to Transduce with Unbounded Memory
Edward Grefenstette, Karl Moritz Hermann, Mustafa Suleyman, and Phil Blunsom · 2015
Cited alongside, same era.
Deep learning
Yann LeCun, Yoshua Bengio, and Geoffrey Hinton · 2015
Cited alongside, same era.
Effective Approaches to Attention-based Neural Machine Translation
Minh-Thang Luong, Hieu Pham, and Christopher D. Manning · 2015
Cited alongside, same era.
End-To-End Memory Networks
Sainbayar Sukhbaatar, Arthur Szlam, Jason Weston, and Rob Fergus · 2015
Cited alongside, same era.
Findings of the 2016 Conference on Machine Translation
Ondřej Bojar, Rajen Chatterjee, Christian Federmann, Yvette Graham, Barry Haddow, Matthias Huck, Antonio Jimeno Yepes, Philipp Koehn, Varvara Logacheva, Christof Monz, Matteo Negri, Aurelie Neveol, Mariana Neves, Martin Popel, Matt Post, Raphael Rubino, Carolina Scarton, Lucia Specia, Marco Turchi, Karin Verspoor, and Marcos Zampieri · 2016
Cited alongside, same era.
Hybrid computing using a neural network with dynamic external memory
Prototypical networks for few-shot learning
Jake Snell, Kevin Swersky, and Richard S Zemel · 2017
Later among the works it cites.
Attention Is All You Need
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Lukasz Kaiser, and Illia Polosukhin · 2017
Later among the works it cites.
Systematic generalization: What is required and can it be learned?
Dzmitry Bahdanau, Shikhar Murty, Michael Noukhovitch, Thien Huu Nguyen, Harm de Vries, and Aaron Courville · 2018
Later among the works it cites.
Jump to better conclusions: SCAN both left and right
Joost Bastings, Marco Baroni, Jason Weston, Kyunghyun Cho, and Douwe Kiela · 2018
Later among the works it cites.
Evaluating Compositionality in Sentence Embeddings
Ishita Dasgupta, Demi Guo, Andreas Stuhlmuller, Samuel J Gershman, and Noah D Goodman · 2018
Later among the works it cites.
Meta-Learning for Low-Resource Neural Machine Translation
Jiatao Gu, Yong Wang, Yun Chen, Kyunghyun Cho, and Victor OK Li · 2018
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Alex Graves, Greg Wayne, Malcolm Reynolds, Tim Harley, Ivo Danihelka, Agnieszka Grabska-Barwińska, Sergio Gómez Colmenarejo, Edward Grefenstette, Tiago Ramalho, John Agapiou, Adrià Puigdomènech Badia, Karl Moritz Hermann, Yori Zwols, Georg Ostrovski, Adam Cain, Helen King, Christopher Summerfield, Phil Blunsom, Koray Kavukcuoglu, and Demis Hassabis · 2016
Cited alongside, same era.
Neural Programmer-Interpreters
Scott Reed and Nando de Freitas · 2016
Cited alongside, same era.
Meta-Learning with Memory-Augmented Neural Networks
Adam Santoro, Sergey Bartunov, Matthew Botvinick, Daan Wierstra, and Timothy Lillicrap · 2016
Cited alongside, same era.
Matching Networks for One Shot Learning
Oriol Vinyals, Charles Blundell, Timothy Lillicrap, Koray Kavukcuoglu, and Daan Wierstra · 2016
Cited alongside, same era.
Learning to reinforcement learn
Jane X Wang, Zeb Kurth-Nelson, Dhruva Tirumala, Hubert Soyer, Joel Z Leibo, Remi Munos, Charles Blundell, Dharshan Kumaran, and Matt Botvinick · 2016
Cited alongside, same era.
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks
Chelsea Finn, Pieter Abbeel, and Sergey Levine · 2017
Cited alongside, same era.
Building machines that learn and think like people
Brenden M Lake, Tomer D Ullman, Joshua B Tenenbaum, and Samuel J Gershman · 2017
Cited alongside, same era.
Later among the works it cites.
Generalization without Systematicity: On the Compositional Skills of Sequence-to-Sequence Recurrent Networks
Brenden M Lake and Marco Baroni · 2018
Later among the works it cites.
Rearranging the Familiar: Testing Compositional Generalization in Recurrent Networks
João Loula, Marco Baroni, and Brenden M Lake · 2018
Later among the works it cites.
Deep Learning: A Critical Appraisal
Gary Marcus · 2018
Later among the works it cites.
Good-Enough Compositional Data Augmentation
Jacob Andreas · 2019
Closest in time.
Mutual exclusivity as a challenge for neural networks
Kanishk Gandhi and Brenden M Lake · 2019
Closest in time.
Learning to Infer Program Sketches
Maxwell Nye, Luke Hewitt, Joshua B. Tenenbaum, and Armando Solar-lezama · 2019
Closest in time.