Fetching the paper…
Reading the bibliography…
Because meaning can often be inferred from lexical semantics alone, word order is often a redundant cue in natural language.
Syntactic structures
Noam Chomsky. 1957 · 1957
Earlier work this paper cites.
The origin of language
Charles F. Hockett. 1960 · 1960
Earlier work this paper cites.
Probing linguistic systematicity
Emily Goodwin, Koustuv Sinha, and Timothy J. O’Donnell. 2020 · 1969
Earlier work this paper cites.
Syntactic processes in sentence production
Merrill F. Garrett. 1976 · 1976
Earlier work this paper cites.
Ergativity
Robert M. W. Dixon. 1979 · 1979
Earlier work this paper cites.
Making and correcting errors during sentence comprehension: Eye movements in the analysis of structurally ambiguous sentences
Lyn Frazier and Keith Rayner. 1982 · 1982
Earlier work this paper cites.
The interaction of syntax and semantics during sentence processing: Eye movements in the analysis of semantically biased sentences
Keith Rayner, Marcia Carlson, and Lyn Frazier. 1983 · 1983
Earlier work this paper cites.
Language Universals and Linguistic Typology , 2nd edition
Bernard Comrie. 1989 · 1989
Earlier work this paper cites.
Use of verb information in syntactic parsing: Evidence from eye movements and word-by-word self-paced reading
Fernanda Ferreira and John M Henderson. 1990 · 1990
Earlier work this paper cites.
Functional approaches to grammar
William A. Croft. 2001 · 2001
Earlier work this paper cites.
Differential object marking: Iconicity vs. economy
Judith Aissen. 2003 · 2003
Earlier work this paper cites.
Language models are few-shot learners
Tom B Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al. 2020 · 2005
Earlier work this paper cites.
Composition in distributional models of semantics
Jeff Mitchell and Mirella Lapata. 2010 · 2010
Cited alongside, same era.
Vector space models of word meaning and phrase meaning: A survey
Katrin Erk. 2012 · 2012
Cited alongside, same era.
A noisy-channel account of crosslinguistic word-order variation
Edward Gibson, Steven T. Piantadosi, Kimberly Brink, Leon Bergen, Eunice Lim, and Rebecca Saxe. 2013 · 2013
Cited alongside, same era.
Colorless green recurrent networks dream hierarchically
Kristina Gulordava, Piotr Bojanowski, Edouard Grave, Tal Linzen, and Marco Baroni. 2018 · 2018
Cited alongside, same era.
BERT: Pre-training of deep bidirectional transformers for language understanding
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019 · 2019
Cited alongside, same era.
Designing and interpreting probes with control tasks
John Hewitt and Percy Liang. 2019 · 2019
BERT & family eat word salad: Experiments with text understanding
Ashim Gupta, Giorgi Kvernadze, and Vivek Srikumar. 2021 · 2021
Later among the works it cites.
Do syntactic probes probe syntax? Experiments with Jabberwocky probing
Rowan Hall Maudslay and Ryan Cotterell. 2021 · 2021
Later among the works it cites.
How effective is BERT without word ordering? Implications for language understanding and data privacy
Jack Hessel and Alexandra Schofield. 2021 · 2021
Later among the works it cites.
Conditional probing: measuring usable information beyond a baseline
John Hewitt, Kawin Ethayarajh, Percy Liang, and Christopher Manning. 2021 · 2021
Later among the works it cites.
What context features can transformer language models use?
Joe O’Connor and Jacob Andreas. 2021 · 2021
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
Emergent linguistic structure in artificial neural networks trained by self-supervision
Christopher D Manning, Kevin Clark, John Hewitt, Urvashi Khandelwal, and Omer Levy. 2020 · 2020
Cited alongside, same era.
Composition is the core driver of the language-selective network
Francis Mollica, Matthew Siegelman, Evgeniia Diachek, Steven T Piantadosi, Zachary Mineroff, Richard Futrell, Hope Kean, Peng Qian, and Evelina Fedorenko. 2020 · 2020
Cited alongside, same era.
Information-theoretic probing for linguistic structure
Tiago Pimentel, Josef Valvoda, Rowan Hall Maudslay, Ran Zmigrod, Adina Williams, and Ryan Cotterell. 2020 · 2020
Cited alongside, same era.
Information-theoretic probing with minimum description length
Elena Voita and Ivan Titov. 2020 · 2020
Cited alongside, same era.
Demystifying neural language models’ insensitivity to word-order
Louis Clouatre, Prasanna Parthasarathi, Amal Zouaq, and Sarath Chandar. 2021 · 2021
Cited alongside, same era.
Deep subjecthood: Higher-order grammatical features in multilingual BERT
Isabel Papadimitriou, Ethan A. Chi, Richard Futrell, and Kyle Mahowald. 2021 · 2021
Later among the works it cites.
Out of Order: How important is the sequential order of words in a sentence in Natural Language Understanding tasks?
Thang Pham, Trung Bui, Long Mai, and Anh Nguyen. 2021 · 2021
Later among the works it cites.
Masked language modeling and the distributional hypothesis: Order word matters pre-training for little
Koustuv Sinha, Robin Jia, Dieuwke Hupkes, Joelle Pineau, Adina Williams, and Douwe Kiela. 2021 · 2021
Later among the works it cites.
Probing Classifiers: Promises, Shortcomings, and Advances
Yonatan Belinkov. 2022 · 2022
Closest in time.
Grammatical cues are largely, but not completely, redundant with word meanings in natural language
Kyle Mahowald, Evgeniia Diachek, Edward Gibson, Evelina Fedorenko, and Richard Futrell. 2022 · 2022
Closest in time.
Redundancy can benefit learning: Evidence from word order and case marking
Shira Tal and Inbal Arnon. 2022 · 2022
Closest in time.