Fetching the paper…
Reading the bibliography…
Recursive processing is considered a hallmark of human linguistic abilities.
Assessing bert’s syntactic abilities
Yoav Goldberg. 2019 · 1901
Earlier work this paper cites.
Memory-augmented recurrent neural networks can learn generalized dyck languages
Mirac Suzgun, Sebastian Gehrmann, Yonatan Belinkov, and Stuart M Shieber. 2019 · 1911
Earlier work this paper cites.
Finite state automata and simple recurrent networks
Axel Cleeremans, David Servan-Schreiber, and James L McClelland. 1989 · 1989
Earlier work this paper cites.
Broken agreement
Kathryn Bock and Carol Miller. 1991 · 1991
Earlier work this paper cites.
Graded state machines: The representation of temporal contingencies in simple recurrent networks
David Servan-Schreiber, Axel Cleeremans, and James L McClelland. 1991 · 1991
Earlier work this paper cites.
Constructing subject-verb agreement in speech: The role of semantic and morphological factors
Gabriella Vigliocco, Brian Butterworth, and Carlo Semenza. 1995 · 1995
Earlier work this paper cites.
Long short-term memory
Sepp Hochreiter and Jürgen Schmidhuber. 1997 · 1997
Earlier work this paper cites.
Toward a connectionist model of recursion in human linguistic performance
Morten Christiansen and Nick Chater. 1999 · 1999
Earlier work this paper cites.
Minimalist inquiries: The framework
Noam Chomsky. 2000 · 2000
Earlier work this paper cites.
LSTM recurrent networks learn simple context-free and context-sensitive languages
Felix Gers and Jürgen Schmidhuber. 2001 · 2001
Earlier work this paper cites.
Subject-verb agreement errors in french and english: The role of syntactic hierarchy
Julie Franck, Gabriella Vigliocco, and Janet Nicol. 2002 · 2002
Earlier work this paper cites.
The faculty of language: What is it, who has it, and how did it evolve?
Marc Hauser, Noam Chomsky, and Tecumseh Fitch. 2002 · 2002
Cited alongside, same era.
A systematic assessment of syntactic generalization in neural language models
Jennifer Hu, Jon Gauthier, Peng Qian, Ethan Wilcox, and Roger P Levy. 2020 · 2005
Cited alongside, same era.
Constraints on multiple center-embedding of clauses
Fred Karlsson. 2007 · 2007
Cited alongside, same era.
Rnns can generate bounded hierarchical languages with optimal memory
John Hewitt, Michael Hahn, Surya Ganguli, Percy Liang, and Christopher D Manning. 2020 · 2010
Cited alongside, same era.
The neural representation of sequences: From transition probabilities to algebraic patterns and linguistic trees
Stanislas Dehaene, Florent Meyniel, Catherine Wacongne, Liping Wang, and Christophe Pallier. 2015 · 2015
Cited alongside, same era.
Analysis methods in neural language processing: A survey
Yonatan Belinkov and James Glass. 2019 · 2019
Later among the works it cites.
Analysing neural language models: Contextual decomposition reveals default reasoning in number and gender assignment
Jaap Jumelet, Willem Zuidema, and Dieuwke Hupkes. 2019 · 2019
Later among the works it cites.
The emergence of number and syntax units in LSTM language models
Yair Lakretz, Germán Kruszewski, Theo Desbordes, Dieuwke Hupkes, Stanislas Dehaene, and Marco Baroni. 2019 · 2019
Later among the works it cites.
Language models are unsupervised multitask learners
Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever, et al. 2019 · 2019
Later among the works it cites.
What limits our capacity to process nested long-range dependencies in sentence comprehension?
Yair Lakretz, Stanislas Dehaene, and Jean-Rémi King. 2020 · 2020
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Assessing the ability of LSTMs to learn syntax-sensitive dependencies
Tal Linzen, Emmanuel Dupoux, and Yoav Goldberg. 2016 · 2016
Cited alongside, same era.
Using deep neural networks to learn syntactic agreement
Jean-Philippe Bernardy and Shalom Lappin. 2017 · 2017
Cited alongside, same era.
Attention is all you need
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017 · 2017
Cited alongside, same era.
Under the hood: Using diagnostic classifiers to investigate and improve how language models track agreement information
Mario Giulianelli, Jack Harding, Florian Mohnert, Dieuwke Hupkes, and Willem Zuidema. 2018 · 2018
Cited alongside, same era.
Colorless green recurrent networks dream hierarchically
Kristina Gulordava, Piotr Bojanowski, Edouard Grave, Tal Linzen, and Marco Baroni. 2018 · 2018
Cited alongside, same era.
Targeted syntactic evaluation of language models
Rebecca Marvin and Tal Linzen. 2018 · 2018
Cited alongside, same era.
Can rnns learn recursive nested subject-verb agreements?
Yair Lakretz, Théo Desbordes, Jean-Rémi King, Benoît Crabbé, Maxime Oquab, and Stanislas Dehaene. 2021a
Cited in the paper.
Alex Warstadt, Alicia Parrish, Haokun Liu, Anhad Mohananey, Wei Peng, Sheng-Fu Wang, and Samuel R. Bowman. 2020 · 2020
Later among the works it cites.
Language models use monotonicity to assess NPI licensing
Jaap Jumelet, Milica Denic, Jakub Szymanik, Dieuwke Hupkes, and Shane Steinert-Threlkeld. 2021 · 2021
Closest in time.
Attention vs non-attention for a shapley-based explanation method
Tom Kersten, Hugh Mee Wong, Jaap Jumelet, and Dieuwke Hupkes. 2021 · 2021
Closest in time.
Transformers generalize linearly
Jackson Petty and Robert Frank. 2021 · 2021
Closest in time.
Koustuv Sinha, Robin Jia, Dieuwke Hupkes, Joelle Pineau, Adina Williams, and Douwe Kiela. 2021 · 2021
Closest in time.