Fetching the paper…
Reading the bibliography…
Deep neural networks drive the success of natural language processing.
Sequence Memory Constraints Give Rise to Language-Like Structure through Iterated Learning
Hannah Cornish, Rick Dale, Simon Kirby, and Morten H. Christiansen · 1932
Earlier work this paper cites.
Adaptive Communication: Languages with More Non-Native Speakers Tend to Have Fewer Word Forms
Christian Bentz, Annemarie Verkerk, Douwe Kiela, Felix Hill, and Paula Buttery · 1932
Earlier work this paper cites.
Connectionist models of recognition memory: Constraints imposed by learning and forgetting functions
Roger Ratcliff · 1939
Earlier work this paper cites.
Distributional Structure
Zellig S. Harris · 1954
Earlier work this paper cites.
The Child’s Learning of English Morphology
Jean Berko · 1958
Earlier work this paper cites.
Learning representations by back-propagating errors
David E. Rumelhart, Geoffrey E. Hinton, and Ronald J. Williams · 1986
Earlier work this paper cites.
Approximation by superpositions of a sigmoidal function
George Cybenko · 1989
Earlier work this paper cites.
Long short-term memory
Sepp Hochreiter and Jürgen Schmidhuber · 1997
Earlier work this paper cites.
The acquisition of case marking by adult learners of Russian and German
Vera Kempe and Brian MacWhinney · 1998
Earlier work this paper cites.
Frege, Contextuality and Compositionality
Theo M.V. Janssen · 2001
Earlier work this paper cites.
The magical number 4 in short-term memory: A reconsideration of mental storage capacity
Nelson Cowan · 2001
Earlier work this paper cites.
The compositionality papers
Jerry A Fodor and Ernest Lepore · 2002
Earlier work this paper cites.
Learning, bottlenecks and the evolution of recursive syntax, 2002
Simon Kirby · 2002
Earlier work this paper cites.
How the poverty of the stimulus solves the poverty of the stimulus
Willem H. Zuidema · 2002
Earlier work this paper cites.
Information theory, inference and learning algorithms
David JC MacKay · 2003
Earlier work this paper cites.
From UG to universals: Linguistic adaptation through iterated learning
Simon Kirby, Kenny Smith, and Henry Brighton · 2004
Earlier work this paper cites.
What Makes Learning Second-Language Grammar Difficult? A Review of Issues
Robert M. DeKeyser · 2005
Earlier work this paper cites.
Constructing a language: A usage-based theory of language acquisition
Michael Tomasello · 2005
Earlier work this paper cites.
Understanding linguistic evolution by visualizing the emergence of topographic mappings
Henry Brighton and Simon Kirby · 2006
Earlier work this paper cites.
Second language learning of complex inflectional systems
Vera Kempe and Patricia J. Brooks · 2008
Earlier work this paper cites.
Cumulative cultural evolution in the laboratory: An experimental approach to the origins of structure in human language
Simon Kirby, Hannah Cornish, and Kenny Smith · 2008
Earlier work this paper cites.
The myth of language universals: Language diversity and its importance for cognitive science
Nicholas Evans and Stephen C. Levinson · 2009
Earlier work this paper cites.
Language structure is partly determined by social structure
Gary Lupyan and Rick Dale · 2010
Earlier work this paper cites.
statsmodels: Econometric and statistical modeling with python
Skipper Seabold and Josef Perktold · 2010
Earlier work this paper cites.
The influence of community on language structure: evidence from two young sign languages
Irit Meir, Assaf Israel, Wendy Sandler, Carol A. Padden, and Mark Aronoff · 2012
Earlier work this paper cites.
The World Atlas of Language Structures Online
Matthew S. Dryer and Martin Haspelmath · 2013
Earlier work this paper cites.
Morphological organization: the low conditional entropy conjecture
Farrell Ackerman and Robert Malouf · 2013
Earlier work this paper cites.
Distributed representations of words and phrases and their compositionality
Tomás Mikolov, Ilya Sutskever, Kai Chen, Gregory S. Corrado, and Jeffrey Dean · 2013
Earlier work this paper cites.
The cultural evolution of language
Monica Tamariz and Simon Kirby · 2015
Earlier work this paper cites.
Compression and communication in the cultural evolution of linguistic structure
Simon Kirby, Monica Tamariz, Hannah Cornish, and Kenny Smith · 2015
Earlier work this paper cites.
Show and tell: A neural image caption generator
Oriol Vinyals, Alexander Toshev, Samy Bengio, and Dumitru Erhan · 2015
Earlier work this paper cites.
Delving deep into rectifiers: Surpassing human-level performance on imagenet classification
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun · 2015
Earlier work this paper cites.
Adam: A method for stochastic optimization
Diederik P. Kingma and Jimmy Ba · 2015
Earlier work this paper cites.
Learning pressures reduce morphological complexity: Linking corpus, computational and experimental evidence
Christian Bentz and Aleksandrs Berdicevskis · 2016
Cited alongside, same era.
Linguistic niches emerge from pressures at multiple timescales
Molly Lewis and Michael C Frank · 2016
Cited alongside, same era.
Deep Learning
Ian Goodfellow, Yoshua Bengio, and Aaron Courville · 2016
Cited alongside, same era.
Natural language does not emerge ‘naturally’ in multi-agent dialog
Satwik Kottur, José Moura, Stefan Lee, and Dhruv Batra · 2017
Cited alongside, same era.
Multi-agent cooperation and the emergence of (natural) language
Angeliki Lazaridou, Alexander Peysakhovich, and Marco Baroni · 2017
Cited alongside, same era.
Transparent and non-transparent languages
Kees Hengeveld and Sterre Leufkens · 2018
Cited alongside, same era.
What makes a language easy to learn? a preregistered study on how systematic structure and community size affect language learnability
Limor Raviv, Marianne de Heer Kloots, and Antje Meyer · 2021
Later among the works it cites.
Cumulative cultural evolution, population structure, and the origin of combinatoriality in human language
Simon Kirby and Monica Tamariz · 2021
Later among the works it cites.
The emergence of systematic argument distinctions in artificial sign languages
Yasamin Motamedi, Kenny Smith, Marieke Schouwstra, Jennifer Culbertson, and Simon Kirby · 2021
Later among the works it cites.
Implicit representations of meaning in neural language models
Belinda Z. Li, Maxwell Nye, and Jacob Andreas · 2021
Later among the works it cites.
Can language models encode perceptual structure without grounding? a case study in color
Mostafa Abdou, Artur Kulmizev, Daniel Hershcovich, Stella Frank, Ellie Pavlick, and Anders Søgaard · 2021
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Generalization without systematicity: On the compositional skills of sequence-to-sequence recurrent networks
Brenden M. Lake and Marco Baroni · 2018
Cited alongside, same era.
Systematicity, but not compositionality: Examining the emergence of linguistic structure in children and adults using iterated learning
Limor Raviv and Inbal Arnon · 2018
Cited alongside, same era.
On the optimization of deep networks: Implicit acceleration by overparameterization
Sanjeev Arora, Nadav Cohen, and Elad Hazan · 2018
Cited alongside, same era.
Emergence of linguistic communication from referential games with symbolic and pixel input
Angeliki Lazaridou, Karl Moritz Hermann, Karl Tuyls, and Stephen Clark · 2018
Cited alongside, same era.
Measuring compositionality in representation learning
Jacob Andreas · 2019
Cited alongside, same era.
Language learning as language use: A cross-linguistic model of child language development
Stewart M. McCauley and Morten H. Christiansen · 2019
Cited alongside, same era.
The neural architecture of language: Integrative modeling converges on predictive processing
Martin Schrimpf, Idan Asher Blank, Greta Tuckute, Carina Kauf, Eghbal A. Hosseini, Nancy Kanwisher, Joshua B. Tenenbaum, and Evelina Fedorenko · 2021
Later among the works it cites.
On the opportunities and risks of foundation models
Rishi Bommasani, Drew A. Hudson, Ehsan Adeli, Russ B. Altman, Simran Arora, Sydney von Arx, Michael S. Bernstein, Jeannette Bohg, Antoine Bosselut, Emma Brunskill, Erik Brynjolfsson, Shyamal Buch, Dallas Card, Rodrigo Castellon, Niladri S. Chatterji, Annie S. Chen, Kathleen Creel, Jared Quincy Davis, Dorottya Demszky, Chris Donahue, Moussa Doumbouya, Esin Durmus, Stefano Ermon, John Etchemendy, Kawin Ethayarajh, Li Fei-Fei, Chelsea Finn, Trevor Gale, Lauren Gillespie, Karan Goel, Noah D. Goodman, Shelby Grossman, Neel Guha, Tatsunori Hashimoto, Peter Henderson, John Hewitt, Daniel E. Ho, Jenny Hong, Kyle Hsu, Jing Huang, Thomas Icard, Saahil Jain, Dan Jurafsky, Pratyusha Kalluri, Siddharth Karamcheti, Geoff Keeling, Fereshte Khani, Omar Khattab, Pang Wei Koh, Mark S. Krass, Ranjay Krishna, Rohith Kuditipudi, and et al · 2021
Later among the works it cites.
Emergent communication of generalizations
Jesse Mu and Noah D. Goodman · 2021
Later among the works it cites.
Compositionality
Zoltán Gendler Szabó · 2022
Later among the works it cites.
Compositional generalization in unsupervised compositional representation learning: A study on disentanglement and emergent language
Zhenlin Xu, Marc Niethammer, and Colin A Raffel · 2022
Later among the works it cites.
Mapping language models to grounded conceptual spaces
Roma Patel and Ellie Pavlick · 2022
Later among the works it cites.
Convergent representations of computer programs in human and artificial neural networks
Shashank Srikant, Ben Lipkin, Anna A Ivanova, Evelina Fedorenko, and Una-May O’Reilly · 2022
Later among the works it cites.
Language models show human-like content effects on reasoning
Ishita Dasgupta, Andrew K. Lampinen, Stephanie C. Y. Chan, Antonia Creswell, Dharshan Kumaran, James L. McClelland, and Felix Hill · 2022
Later among the works it cites.
Emergent abilities of large language models
Jason Wei, Yi Tay, Rishi Bommasani, Colin Raffel, Barret Zoph, Sebastian Borgeaud, Dani Yogatama, Maarten Bosma, Denny Zhou, Donald Metzler, Ed H. Chi, Tatsunori Hashimoto, Oriol Vinyals, Percy Liang, Jeff Dean, and William Fedus · 2022
Later among the works it cites.
Emergent communication for understanding human language evolution: What’s missing?
Lukas Galke, Yoav Ram, and Limor Raviv · 2022
Later among the works it cites.
Quantifying memorization across neural language models
Nicholas Carlini, Daphne Ippolito, Matthew Jagielski, Katherine Lee, Florian Tramèr, and Chiyuan Zhang · 2022
Later among the works it cites.
Memorization without overfitting: Analyzing the training dynamics of large language models
Kushal Tirumala, Aram Markosyan, Luke Zettlemoyer, and Armen Aghajanyan · 2022
Later among the works it cites.
Training language models to follow instructions with human feedback
Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, John Schulman, Jacob Hilton, Fraser Kelton, Luke Miller, Maddie Simens, Amanda Askell, Peter Welinder, Paul F. Christiano, Jan Leike, and Ryan Lowe · 2022
Later among the works it cites.
Learnability effects in Children: are more structured languages easier to learn?, July 2022
Imme Lammertink, Mary Bazioni, Marianne de Heer Kloots, and Limor Raviv · 2022
Later among the works it cites.
One country, 700+ languages: NLP challenges for underrepresented languages and dialects in Indonesia
Alham Fikri Aji, Genta Indra Winata, Fajri Koto, Samuel Cahyawijaya, Ade Romadhony, Rahmad Mahendra, Kemal Kurniawan, David Moeljadi, Radityo Eko Prasojo, Timothy Baldwin, Jey Han Lau, and Sebastian Ruder · 2022
Later among the works it cites.
Emergent communication at scale
Rahma Chaabouni, Florian Strub, Florent Altché, Eugene Tarassov, Corentin Tallec, Elnaz Davoodi, Kory Wallace Mathewson, Olivier Tieleman, Angeliki Lazaridou, and Bilal Piot · 2022
Later among the works it cites.
Degrees of algorithmic equivalence between the brain and its DNN models
Philippe G. Schyns, Lukas Snoek, and Christoph Daube · 2022
Later among the works it cites.
Human-like systematic generalization through a meta-learning neural network
Brenden M. Lake and Marco Baroni · 2023
Closest in time.
LexSym: Compositionality as lexical symmetry
Ekin Akyurek and Jacob Andreas · 2023
Closest in time.
State-of-the-art generalisation research in NLP: A taxonomy and review
Dieuwke Hupkes, Mario Giulianelli, Verna Dankers, Mikel Artetxe, Yanai Elazar, Tiago Pimentel, Christos Christodoulopoulos, Karim Lasri, Naomi Saphra, Arabella Sinclair, Dennis Ulmer, Florian Schottmann, Khuyagbaatar Batsuren, Kaiser Sun, Koustuv Sinha, Leila Khalatbari, Maria Ryskina, Rita Frieske, Ryan Cotterell, and Zhijing Jin · 2023
Closest in time.
Emergent world representations: Exploring a sequence model trained on a synthetic task
Kenneth Li, Aspen K. Hopkins, David Bau, Fernanda Viégas, Hanspeter Pfister, and Martin Wattenberg · 2023
Closest in time.
Compositionality with variation reliably emerges in neural networks
Henry Conklin and Kenny Smith · 2023
Closest in time.
Modern language models refute Chomsky’s approach to language, 2023
Steven Piantadosi · 2023
Closest in time.
GenCodeSearchNet: A benchmark test suite for evaluating generalization in programming language understanding
Andor Diera, Abdelhalim Dahou, Lukas Galke, Fabian Karl, Florian Sihler, and Ansgar Scherp · 2023
Closest in time.
Grounded language acquisition through the eyes and ears of a single child
Wai Keen Vong, Wentao Wang, A. Emin Orhan, and Brenden M. Lake · 2024
Closest in time.
To code, or not to code? exploring impact of code in pre-training, 2024
Viraat Aryabumi, Yixuan Su, Raymond Ma, Adrien Morisot, Ivan Zhang, Acyr Locatelli, Marzieh Fadaee, Ahmet Üstün, and Sara Hooker · 2024
Closest in time.
Infinitely productive language can arise from chance under communicative pressure
Steven T. Piantadosi and Evelina Fedorenko · 2058
Closest in time.