Fetching the paper…
Reading the bibliography…
Finding and facilitating commonalities between the linguistic behaviors of large language models and humans could lead to major breakthroughs in our understanding of the acquisition, processing, and evolution of language.
“Human behavior and the principle of least effort: An introduction to human ecology”, 1949
George Zipf · 1949
Earlier work this paper cites.
“Human behavior and the principle of least effort: An introduction to human ecology”, 1949
George Zipf · 1949
Earlier work this paper cites.
“Distributional Structure”
Zellig. Harris · 1954
Earlier work this paper cites.
“Distributional Structure”
Zellig. Harris · 1954
Earlier work this paper cites.
“The origin of speech”
Charles Hockett · 1960
Earlier work this paper cites.
“The origin of speech”
Charles Hockett · 1960
Earlier work this paper cites.
“The Need for Biases in Learning Generalizations”, 1980
Tom Mitchell · 1980
Earlier work this paper cites.
“The Need for Biases in Learning Generalizations”, 1980
Tom Mitchell · 1980
Earlier work this paper cites.
“Approximation by Superpositions of a Sigmoidal Function”
George Cybenko · 1989
Earlier work this paper cites.
“Approximation by Superpositions of a Sigmoidal Function”
George Cybenko · 1989
Earlier work this paper cites.
“Learning and Development in Neural Networks: The Importance of Starting Small”
Jeffrey. Elman · 1993
Earlier work this paper cites.
“Learning and Development in Neural Networks: The Importance of Starting Small”
Jeffrey. Elman · 1993
Earlier work this paper cites.
“Theory of modeling and simulation”
Bernard Zeigler, Herbert Praehofer and Tag Kim · 2000
Earlier work this paper cites.
“Theory of modeling and simulation”
Bernard Zeigler, Herbert Praehofer and Tag Kim · 2000
Earlier work this paper cites.
“Learning, bottlenecks and the evolution of recursive syntax”, 2002
Simon Kirby · 2002
Earlier work this paper cites.
“How the poverty of the stimulus solves the poverty of the stimulus”
Willem Zuidema · 2002
Earlier work this paper cites.
“Learning, bottlenecks and the evolution of recursive syntax”, 2002
Simon Kirby · 2002
Earlier work this paper cites.
“How the poverty of the stimulus solves the poverty of the stimulus”
Willem Zuidema · 2002
Earlier work this paper cites.
“Complex systems in language evolution: the cultural emergence of compositional structure”
Kenny Smith, Henry Brighton and Simon Kirby · 2003
Earlier work this paper cites.
“Complex systems in language evolution: the cultural emergence of compositional structure”
Kenny Smith, Henry Brighton and Simon Kirby · 2003
Earlier work this paper cites.
“From UG to universals: Linguistic adaptation through iterated learning”
Simon Kirby, Kenny Smith and Henry Brighton · 2004
Earlier work this paper cites.
“From UG to universals: Linguistic adaptation through iterated learning”
Simon Kirby, Kenny Smith and Henry Brighton · 2004
Earlier work this paper cites.
“Power laws, Pareto distributions and Zipf’s law”
Mark Newman · 2005
Earlier work this paper cites.
“Power laws, Pareto distributions and Zipf’s law”
Mark Newman · 2005
Earlier work this paper cites.
“Understanding Linguistic Evolution by Visualizing the Emergence of Topographic Mappings”
Henry Brighton and Simon Kirby · 2006
Earlier work this paper cites.
“Understanding Linguistic Evolution by Visualizing the Emergence of Topographic Mappings”
Henry Brighton and Simon Kirby · 2006
Earlier work this paper cites.
“The emergence of simple languages in an experimental coordination game”
Reinhard Selten and Massimo Warglien · 2007
Earlier work this paper cites.
“The consequences of talking to strangers: Evolutionary corollaries of socio-cultural influences on linguistic form”
Alison Wray and George Grace · 2007
Earlier work this paper cites.
“The emergence of simple languages in an experimental coordination game”
Reinhard Selten and Massimo Warglien · 2007
Earlier work this paper cites.
“The consequences of talking to strangers: Evolutionary corollaries of socio-cultural influences on linguistic form”
Alison Wray and George Grace · 2007
Earlier work this paper cites.
“Exploring social structure effect on language evolution based on a computational model”
Tao Gong, James Minett and William-Y Wang · 2008
Earlier work this paper cites.
“Cumulative cultural evolution in the laboratory: An experimental approach to the origins of structure in human language”
Simon Kirby, Hannah Cornish and Kenny Smith · 2008
Earlier work this paper cites.
“Cultural evolution: implications for understanding the human language faculty and its evolution”
Kenny Smith and Simon Kirby · 2008
Earlier work this paper cites.
“Origins of Human Communication”
Michael Tomasello · 2008
Earlier work this paper cites.
“Exploring social structure effect on language evolution based on a computational model”
Tao Gong, James Minett and William-Y Wang · 2008
Earlier work this paper cites.
“Cumulative cultural evolution in the laboratory: An experimental approach to the origins of structure in human language”
Simon Kirby, Hannah Cornish and Kenny Smith · 2008
Earlier work this paper cites.
“Cultural evolution: implications for understanding the human language faculty and its evolution”
Kenny Smith and Simon Kirby · 2008
Earlier work this paper cites.
“Origins of Human Communication”
Michael Tomasello · 2008
Earlier work this paper cites.
“Language Acquisition Meets Language Evolution”
Nick Chater and Morten. Christiansen · 2009
Earlier work this paper cites.
“Input and Second Language Acquisition: The Roles of Frequency, Form, and Function Introduction to the Special Issue”
Nick Ellis and Laura Collins · 2009
Earlier work this paper cites.
“The Evolution of Frequency Distributions: Relating Regularization to Inductive Biases through Iterated Learning”
Florencia Reali and Thomas. Griffiths · 2009
Earlier work this paper cites.
“Language Acquisition Meets Language Evolution”
Nick Chater and Morten. Christiansen · 2009
Earlier work this paper cites.
“Input and Second Language Acquisition: The Roles of Frequency, Form, and Function Introduction to the Special Issue”
Nick Ellis and Laura Collins · 2009
Earlier work this paper cites.
“The Evolution of Frequency Distributions: Relating Regularization to Inductive Biases through Iterated Learning”
Florencia Reali and Thomas. Griffiths · 2009
Earlier work this paper cites.
“Language structure is partly determined by social structure”
Gary Lupyan and Rick Dale · 2010
Earlier work this paper cites.
“Language structure is partly determined by social structure”
Gary Lupyan and Rick Dale · 2010
Earlier work this paper cites.
“Understanding the origins of morphological diversity: The linguistic niche hypothesis”
Rick Dale and Gary Lupyan · 2012
Earlier work this paper cites.
“The influence of community on language structure: evidence from two young sign languages”
Irit Meir et al · 2012
Earlier work this paper cites.
“Social scale and structural complexity in human languages”
Daniel Nettle · 2012
Earlier work this paper cites.
“Understanding the origins of morphological diversity: The linguistic niche hypothesis”
Rick Dale and Gary Lupyan · 2012
Earlier work this paper cites.
“The influence of community on language structure: evidence from two young sign languages”
Irit Meir et al · 2012
Earlier work this paper cites.
“Social scale and structural complexity in human languages”
Daniel Nettle · 2012
Earlier work this paper cites.
“Distributed Representations of Words and Phrases and Their Compositionality”
Tomas Mikolov et al · 2013
Earlier work this paper cites.
“Distributed Representations of Words and Phrases and Their Compositionality”
Tomas Mikolov et al · 2013
Earlier work this paper cites.
“Iterated learning and the evolution of language”
Simon Kirby, Tom Griffiths and Kenny Smith · 2014
Earlier work this paper cites.
“Language evolution can be shaped by the structure of the world”
Andrew Perfors and Daniel Navarro · 2014
Earlier work this paper cites.
“Iterated learning and the evolution of language”
Simon Kirby, Tom Griffiths and Kenny Smith · 2014
Earlier work this paper cites.
“Language evolution can be shaped by the structure of the world”
Andrew Perfors and Daniel Navarro · 2014
Earlier work this paper cites.
“Neural Machine Translation by Jointly Learning to Align and Translate”
Dzmitry Bahdanau, Kyunghyun Cho and Yoshua Bengio · 2015
Earlier work this paper cites.
“Compression and communication in the cultural evolution of linguistic structure”
Simon Kirby, Monica Tamariz, Hannah Cornish and Kenny Smith · 2015
Earlier work this paper cites.
“Languages adapt to their contextual niche”
James Winters, Simon Kirby and Kenny Smith · 2015
Earlier work this paper cites.
“Neural Machine Translation by Jointly Learning to Align and Translate”
Dzmitry Bahdanau, Kyunghyun Cho and Yoshua Bengio · 2015
Earlier work this paper cites.
“Compression and communication in the cultural evolution of linguistic structure”
Simon Kirby, Monica Tamariz, Hannah Cornish and Kenny Smith · 2015
Earlier work this paper cites.
“Languages adapt to their contextual niche”
James Winters, Simon Kirby and Kenny Smith · 2015
Earlier work this paper cites.
“Learning to Communicate with Deep Multi-Agent Reinforcement Learning”
Jakob Foerster, Ioannis Assael, Nando de Freitas and Shimon Whiteson · 2016
Earlier work this paper cites.
“Deep or Shallow, NLP Is Breaking Out”
Gregory Goth · 2016
Earlier work this paper cites.
“Agent-based models for the emergence and evolution of grammar”
Luc Steels · 2016
Earlier work this paper cites.
“Learning to Communicate with Deep Multi-Agent Reinforcement Learning”
Jakob Foerster, Ioannis Assael, Nando de Freitas and Shimon Whiteson · 2016
Earlier work this paper cites.
“Deep or Shallow, NLP Is Breaking Out”
Gregory Goth · 2016
Earlier work this paper cites.
“Agent-based models for the emergence and evolution of grammar”
Luc Steels · 2016
Earlier work this paper cites.
“The emergence of linguistic structure in an online iterated learning task”
Clay Beckner, Janet Pierrehumbert and Jennifer Hay · 2017
Earlier work this paper cites.
“The cultural evolution of structured languages in an open-ended, continuous world”
Jon Carr, Kenny Smith, Hannah Cornish and Simon Kirby · 2017
Earlier work this paper cites.
“Cognitive Science in the Era of Artificial Intelligence: A Roadmap for Reverse-Engineering the Infant Language-Learner”
Emmanuel Dupoux · 2017
Earlier work this paper cites.
“Emergence of Language with Multi-agent Games: Learning to Communicate with Sequences of Symbols”
Serhii Havrylov and Ivan Titov · 2017
Earlier work this paper cites.
“Zipf’s law of abbreviation and the principle of least effort: Language users optimise a miniature lexicon for efficient communication”
Jasmeen Kanwal, Kenny Smith, Jennifer Culbertson and Simon Kirby · 2017
Earlier work this paper cites.
“Culture and biology in the origins of linguistic structure”
Simon Kirby · 2017
Earlier work this paper cites.
“Natural Language Does Not Emerge ‘Naturally’ in Multi-Agent Dialog”
Satwik Kottur, José Moura, Stefan Lee and Dhruv Batra · 2017
Earlier work this paper cites.
“Multi-Agent Cooperation and the Emergence of (Natural) Language”
Angeliki Lazaridou, Alexander Peysakhovich and Marco Baroni · 2017
Earlier work this paper cites.
“Proximal policy optimization algorithms”
John Schulman et al · 2017
Earlier work this paper cites.
“Attention is All you Need”
Ashish Vaswani et al · 2017
Cited alongside, same era.
“Recovery Guarantees for One-hidden-layer Neural Networks”
Kai Zhong et al · 2017
Cited alongside, same era.
“The emergence of linguistic structure in an online iterated learning task”
Clay Beckner, Janet Pierrehumbert and Jennifer Hay · 2017
Cited alongside, same era.
“The cultural evolution of structured languages in an open-ended, continuous world”
Jon Carr, Kenny Smith, Hannah Cornish and Simon Kirby · 2017
Cited alongside, same era.
“Cognitive Science in the Era of Artificial Intelligence: A Roadmap for Reverse-Engineering the Infant Language-Learner”
Emmanuel Dupoux · 2017
Cited alongside, same era.
“Emergence of Language with Multi-agent Games: Learning to Communicate with Sequences of Symbols”
Serhii Havrylov and Ivan Titov · 2017
“The Neural Architecture of Language: Integrative Modeling Converges on Predictive Processing”
Martin Schrimpf et al · 2021
Later among the works it cites.
“Can Language Models Encode Perceptual Structure Without Grounding? A Case Study in Color”
Mostafa Abdou et al · 2021
Later among the works it cites.
“On the proper role of linguistically-oriented deep net analysis in linguistic theorizing”
Marco Baroni · 2021
Later among the works it cites.
“Psiphi-learning: Reinforcement learning with demonstrations using successor features and inverse temporal difference learning”
Angelos Filos et al · 2021
Later among the works it cites.
“BabyBERTa: Learning More Grammar With Small-Scale Child-Directed Language”
Philip. Huebner, Elior Sulem, Fisher Cynthia and Dan Roth · 2021
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
“Zipf’s law of abbreviation and the principle of least effort: Language users optimise a miniature lexicon for efficient communication”
Jasmeen Kanwal, Kenny Smith, Jennifer Culbertson and Simon Kirby · 2017
Cited alongside, same era.
“Culture and biology in the origins of linguistic structure”
Simon Kirby · 2017
Cited alongside, same era.
“Natural Language Does Not Emerge ‘Naturally’ in Multi-Agent Dialog”
Satwik Kottur, José Moura, Stefan Lee and Dhruv Batra · 2017
Cited alongside, same era.
“Multi-Agent Cooperation and the Emergence of (Natural) Language”
Angeliki Lazaridou, Alexander Peysakhovich and Marco Baroni · 2017
Cited alongside, same era.
“Proximal policy optimization algorithms”
John Schulman et al · 2017
Cited alongside, same era.
“Attention is All you Need”
Ashish Vaswani et al · 2017
Cited alongside, same era.
“Implicit Representations of Meaning in Neural Language Models”
Belinda. Li, Maxwell Nye and Jacob Andreas · 2021
Later among the works it cites.
“The Effect of Efficient Messaging and Input Variability on Neural-Agent Iterated Language Learning”
Yuchen Lian, Arianna Bisazza and Tessa Verhoef · 2021
Later among the works it cites.
“Discrete-Valued Neural Communication”
Dianbo Liu et al · 2021
Later among the works it cites.
“Formal variation in the Kata Kolok lexicon”
Hannah Lutzenberger, Connie De, Onno Crasborn and Paula Fikkert · 2021
Later among the works it cites.
“Deep double descent: Where bigger models and more data hurt”
Preetum Nakkiran et al · 2021
Later among the works it cites.
“Emergent social learning via multi-agent reinforcement learning”
Kamal Ndousse, Douglas Eck, Sergey Levine and Natasha Jaques · 2021
Later among the works it cites.
“The Emergence of the Shape Bias Results from Communicative Efficiency”
Eva Portelance et al · 2021
Later among the works it cites.
“What makes a language easy to learn? A preregistered study on how systematic structure and community size affect language learnability”
Limor Raviv, Marianne de Heer and Antje Meyer · 2021
Later among the works it cites.
“The Neural Architecture of Language: Integrative Modeling Converges on Predictive Processing”
Martin Schrimpf et al · 2021
Later among the works it cites.
“Emergent Communication at Scale”
Rahma Chaabouni et al · 2022
Later among the works it cites.
“Compositionality with Variation Reliably Emerges in Neural Networks”
Henry Conklin and Kenny Smith · 2022
Later among the works it cites.
“Language Models Show Human-like Content Effects on Reasoning”
Ishita Dasgupta et al · 2022
Later among the works it cites.
“Emergent Communication for Understanding Human Language Evolution: What’s Missing?”
Lukas Galke, Yoav Ram and Limor Raviv · 2022
Later among the works it cites.
“Learning Causal Overhypotheses through Exploration in Children and Computational Models”
Eliza Kosoy et al · 2022
Later among the works it cites.
“The Primacy Bias in Deep Reinforcement Learning”
Evgenii Nikishin et al · 2022
Later among the works it cites.
“Training Language Models to Follow Instructions with Human Feedback”
Long Ouyang et al · 2022
Later among the works it cites.
“Mapping Language Models to Grounded Conceptual Spaces”
Roma Patel and Ellie Pavlick · 2022
Later among the works it cites.
“On the role of population heterogeneity in emergent communication”
Mathieu Rita et al · 2022
Later among the works it cites.
“Emergent Communication: Generalization and Overfitting in Lewis Games”
Mathieu Rita et al · 2022
Later among the works it cites.
“How language learning and language use create linguistic structure”
Kenny Smith · 2022
Later among the works it cites.
“Convergent Representations of Computer Programs in Human and Artificial Neural Networks”
Shashank Srikant et al · 2022
Later among the works it cites.
“Compositionality”
Zoltán Szabó · 2022
Later among the works it cites.
“What Artificial Neural Networks Can Tell Us About Human Language Acquisition”
Alex Warstadt and Samuel. Bowman · 2022
Later among the works it cites.
“Emergent Abilities of Large Language Models”
Jason Wei et al · 2022
Later among the works it cites.
“Fortuitous Forgetting in Connectionist Networks”
Hattie Zhou, Ankit Vani, Hugo Larochelle and Aaron Courville · 2022
Later among the works it cites.
“Emergent Communication at Scale”
Rahma Chaabouni et al · 2022
Later among the works it cites.
“Compositionality with Variation Reliably Emerges in Neural Networks”
Henry Conklin and Kenny Smith · 2022
Later among the works it cites.
“Language Models Show Human-like Content Effects on Reasoning”
Ishita Dasgupta et al · 2022
Later among the works it cites.
“Emergent Communication for Understanding Human Language Evolution: What’s Missing?”
Lukas Galke, Yoav Ram and Limor Raviv · 2022
Later among the works it cites.
“Learning Causal Overhypotheses through Exploration in Children and Computational Models”
Eliza Kosoy et al · 2022
Later among the works it cites.
“The Primacy Bias in Deep Reinforcement Learning”
Evgenii Nikishin et al · 2022
Later among the works it cites.
“Training Language Models to Follow Instructions with Human Feedback”
Long Ouyang et al · 2022
Later among the works it cites.
“Mapping Language Models to Grounded Conceptual Spaces”
Roma Patel and Ellie Pavlick · 2022
Later among the works it cites.
“On the role of population heterogeneity in emergent communication”
Mathieu Rita et al · 2022
Later among the works it cites.
“Emergent Communication: Generalization and Overfitting in Lewis Games”
Mathieu Rita et al · 2022
Later among the works it cites.
“How language learning and language use create linguistic structure”
Kenny Smith · 2022
Later among the works it cites.
“Convergent Representations of Computer Programs in Human and Artificial Neural Networks”
Shashank Srikant et al · 2022
Later among the works it cites.
“Compositionality”
Zoltán Szabó · 2022
Later among the works it cites.
“What Artificial Neural Networks Can Tell Us About Human Language Acquisition”
Alex Warstadt and Samuel. Bowman · 2022
Later among the works it cites.
“Emergent Abilities of Large Language Models”
Jason Wei et al · 2022
Later among the works it cites.
“Fortuitous Forgetting in Connectionist Networks”
Hattie Zhou, Ankit Vani, Hugo Larochelle and Aaron Courville · 2022
Later among the works it cites.
“Turning large language models into cognitive models”
Marcel Binz and Eric Schulz · 2023
Later among the works it cites.
“Towards More Human-like AI Communication: A Review of Emergent Communication Research”
Nicolo Brandizzi · 2023
Later among the works it cites.
“Large Language Models Demonstrate the Potential of Statistical Learning in Language”
Pablo Contreras, Ross Kristensen-McLachlan and Morten. Christiansen · 2023
Later among the works it cites.
“Realistic and Broad-Scope Learning Simulations: First Results and Challenges”
Maureen De, Marvin Lavechin and Emmanuel Dupoux · 2023
Later among the works it cites.
“Using Large Language Models in Psychology”
Dorottya Demszky et al · 2023
Later among the works it cites.
“What makes a language easy to deep-learn?”
Lukas Galke, Yoav Ram and Limor Raviv · 2023
Later among the works it cites.
“Emergent World Representations: Exploring a Sequence Model Trained on a Synthetic Task”
Kenneth Li et al · 2023
Later among the works it cites.
“Communication Drives the Emergence of Language Universals in Neural Agents: Evidence from the Word-order/Case-marking Trade-off”
Yuchen Lian, Arianna Bisazza and Tessa Verhoef · 2023
Later among the works it cites.
“Revisiting Populations in Multi-Agent Communication”
Paul Michel et al · 2023
Later among the works it cites.
OpenAI · 2023
Later among the works it cites.
“Llama 2: Open foundation and fine-tuned chat models”
Hugo Touvron et al · 2023
Later among the works it cites.
“Discrete Key-Value Bottleneck”
Frederik Träuble et al · 2023
Later among the works it cites.
Alex Warstadt et al · 2023
Later among the works it cites.
“Emergent Analogical Reasoning in Large Language Models”
Taylor Webb, Keith. Holyoak and Hongjing Lu · 2023
Later among the works it cites.
“Turning large language models into cognitive models”
Marcel Binz and Eric Schulz · 2023
Later among the works it cites.
“Towards More Human-like AI Communication: A Review of Emergent Communication Research”
Nicolo Brandizzi · 2023
Later among the works it cites.
“Large Language Models Demonstrate the Potential of Statistical Learning in Language”
Pablo Contreras, Ross Kristensen-McLachlan and Morten. Christiansen · 2023
Later among the works it cites.
“Realistic and Broad-Scope Learning Simulations: First Results and Challenges”
Maureen De, Marvin Lavechin and Emmanuel Dupoux · 2023
Later among the works it cites.
“Using Large Language Models in Psychology”
Dorottya Demszky et al · 2023
Later among the works it cites.
“What makes a language easy to deep-learn?”
Lukas Galke, Yoav Ram and Limor Raviv · 2023
Later among the works it cites.
“Emergent World Representations: Exploring a Sequence Model Trained on a Synthetic Task”
Kenneth Li et al · 2023
Later among the works it cites.
“Communication Drives the Emergence of Language Universals in Neural Agents: Evidence from the Word-order/Case-marking Trade-off”
Yuchen Lian, Arianna Bisazza and Tessa Verhoef · 2023
Later among the works it cites.
“Revisiting Populations in Multi-Agent Communication”
Paul Michel et al · 2023
Later among the works it cites.
OpenAI · 2023
Later among the works it cites.
“Llama 2: Open foundation and fine-tuned chat models”
Hugo Touvron et al · 2023
Later among the works it cites.
“Discrete Key-Value Bottleneck”
Frederik Träuble et al · 2023
Later among the works it cites.
Alex Warstadt et al · 2023
Later among the works it cites.
“Emergent Analogical Reasoning in Large Language Models”
Taylor Webb, Keith. Holyoak and Hongjing Lu · 2023
Later among the works it cites.
“Sudden Drops in the Loss: Syntax Acquisition, Phase Transitions, and Simplicity Bias in MLMs”
Angelica Chen et al · 2024
Closest in time.
Prasann Singhal, Tanya Goyal, Jiacheng Xu and Greg Durrett · 2024
Closest in time.
“Sudden Drops in the Loss: Syntax Acquisition, Phase Transitions, and Simplicity Bias in MLMs”
Angelica Chen et al · 2024
Closest in time.
Prasann Singhal, Tanya Goyal, Jiacheng Xu and Greg Durrett · 2024
Closest in time.