Fetching the paper…
Reading the bibliography…
As it has been unveiled that pre-trained language models (PLMs) are to some extent capable of recognizing syntactic concepts in natural language, much effort has been made to develop a method for extracting complete (binary) parses from PLMs without training separate parsers.
Inducing syntactic trees from bert representations
Rudolf Rosa and David Mareček. 2019 · 1906
Earlier work this paper cites.
Roberta: A robustly optimized bert pretraining approach
Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019 · 1907
Earlier work this paper cites.
Unsupervised cross-lingual representation learning at scale
Alexis Conneau, Kartikay Khandelwal, Naman Goyal, Vishrav Chaudhary, Guillaume Wenzek, Francisco Guzmán, Edouard Grave, Myle Ott, Luke Zettlemoyer, and Veselin Stoyanov. 2019 · 1911
Earlier work this paper cites.
Camembert: a tasty french language model
Louis Martin, Benjamin Muller, Pedro Javier Ortiz Suárez, Yoann Dupont, Laurent Romary, Éric Villemonte de la Clergerie, Djamé Seddah, and Benoît Sagot. 2019 · 1911
Earlier work this paper cites.
An efficient recognition and syntax-analysis algorithm for context-free languages
Tadao Kasami. 1966 · 1966
Earlier work this paper cites.
Recognition and parsing of context-free languages in time n3
Daniel H Younger. 1967 · 1967
Earlier work this paper cites.
Programming languages and their compilers: Preliminary notes
John Cocke. 1969 · 1969
Earlier work this paper cites.
Building a large annotated corpus of English: The Penn Treebank
Mitchell P. Marcus, Beatrice Santorini, and Mary Ann Marcinkiewicz. 1993 · 1993
Earlier work this paper cites.
A maximum-entropy-inspired parser
Eugene Charniak. 2000 · 2000
Earlier work this paper cites.
Head-driven statistical models for natural language parsing
Michael Collins. 2003 · 2003
Earlier work this paper cites.
Learning accurate, compact, and interpretable tree annotation
Slav Petrov, Leon Barrett, Romain Thibaux, and Dan Klein. 2006 · 2006
Earlier work this paper cites.
Overview of the SPMRL 2013 shared task: A cross-framework evaluation of parsing morphologically rich languages
Djamé Seddah, Reut Tsarfaty, Sandra Kübler, Marie Candito, Jinho D. Choi, Richárd Farkas, Jennifer Foster, Iakes Goenaga, Koldo Gojenola Galletebeitia, Yoav Goldberg, Spence Green, Nizar Habash, Marco Kuhlmann, Wolfgang Maier, Joakim Nivre, Adam Przepiórkowski, Ryan Roth, Wolfgang Seeker, Yannick Versley, Veronika Vincze, Marcin Woliński, Alina Wróblewska, and Eric Villemonte de la Clergerie. 2013 · 2013
Earlier work this paper cites.
Neural CRF parsing
Greg Durrett and Dan Klein. 2015 · 2015
Cited alongside, same era.
A minimal span-based neural constituency parser
Mitchell Stern, Jacob Andreas, and Dan Klein. 2017 · 2017
Cited alongside, same era.
Attention is all you need
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017 · 2017
Cited alongside, same era.
Constituency parsing with a self-attentive encoder
Nikita Kitaev and Dan Klein. 2018 · 2018
Cited alongside, same era.
What does BERT look at? an analysis of BERT’s attention
Kevin Clark, Urvashi Khandelwal, Omer Levy, and Christopher D. Manning. 2019 · 2019
Cited alongside, same era.
Cross-lingual language model pretraining
Alexis Conneau and Guillaume Lample. 2019 · 2019
Cited alongside, same era.
How multilingual is multilingual BERT?
Telmo Pires, Eva Schlinger, and Dan Garrette. 2019 · 2019
Later among the works it cites.
Language models are unsupervised multitask learners
Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. 2019 · 2019
Later among the works it cites.
Ordered neurons: Integrating tree structures into recurrent neural networks
Yikang Shen, Shawn Tan, Alessandro Sordoni, and Aaron Courville. 2019 · 2019
Later among the works it cites.
Xlnet: Generalized autoregressive pretraining for language understanding
Zhilin Yang, Zihang Dai, Yiming Yang, Jaime Carbonell, Russ R Salakhutdinov, and Quoc V Le. 2019 · 2019
Later among the works it cites.
Head-driven phrase structure grammar parsing on Penn treebank
Junru Zhou and Hai Zhao. 2019 · 2019
Later among the works it cites.
Multilingual alignment of contextual word representations
Steven Cao, Nikita Kitaev, and Dan Klein. 2020 · 2020
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
BERT: Pre-training of deep bidirectional transformers for language understanding
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019 · 2019
Cited alongside, same era.
A structural probe for finding syntax in word representations
John Hewitt and Christopher D. Manning. 2019 · 2019
Cited alongside, same era.
What does BERT learn about the structure of language?
Ganesh Jawahar, Benoît Sagot, and Djamé Seddah. 2019 · 2019
Cited alongside, same era.
Neural unsupervised parsing beyond English
Katharina Kann, Anhad Mohananey, Samuel R. Bowman, and Kyunghyun Cho. 2019 · 2019
Cited alongside, same era.
Multilingual constituency parsing with self-attention and pre-training
Nikita Kitaev, Steven Cao, and Dan Klein. 2019 · 2019
Cited alongside, same era.
From balustrades to pierre vinken: Looking for syntax in transformer self-attentions
David Mareček and Rudolf Rosa. 2019 · 2019
Cited alongside, same era.
Closest in time.
Finding universal grammatical relations in multilingual BERT
Ethan A. Chi, John Hewitt, and Christopher D. Manning. 2020 · 2020
Closest in time.
Are pre-trained language models aware of phrases? simple but strong baselines for grammar induction
Taeuk Kim, Jihun Choi, Daniel Edmiston, and Sang goo Lee. 2020 · 2020
Closest in time.
Heads-up! unsupervised constituency parsing via self-attention heads
Bowen Li, Taeuk Kim, Reinald Kim Amplayo, and Frank Keller. 2020 · 2020
Closest in time.
On the role of supervision in unsupervised constituency parsing
Haoyue Shi, Karen Livescu, and Kevin Gimpel. 2020 · 2020
Closest in time.
Perturbed masking: Parameter-free probing for analyzing and interpreting BERT
Zhiyong Wu, Yun Chen, Ben Kao, and Qun Liu. 2020 · 2020
Closest in time.
An empirical study of compound pcfgs
Yanpeng Zhao and Ivan Titov. 2021 · 2021
Closest in time.