Fetching the paper…
Reading the bibliography…
With the methodological support of probing (or diagnostic classification), recent studies have demonstrated that Transformers encode syntactic and semantic information to some extent.
Roberta: A robustly optimized bert pretraining approach
Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019 · 1907
Earlier work this paper cites.
A standard corpus of edited present-day american english
W. Nelson Francis. 1965 · 1965
Earlier work this paper cites.
Sweetening ontologies with dolce
Aldo Gangemi, Nicola Guarino, Claudio Masolo, Alessandro Oltramari, and Luc Schneider. 2002 · 2002
Earlier work this paper cites.
Wonderweb deliverable d17. the wonderweb library of foundational ontologies and the dolce ontology
Claudio Masolo, Stefano Borgo, Aldo Gangemi, Nicola Guarino, Alessandro Oltramari, and Luc Schneider. 2002 · 2002
Earlier work this paper cites.
Sweetening wordnet with dolce
Aldo Gangemi, Nicola Guarino, Claudio Masolo, and Alessandro Oltramari. 2003 · 2003
Earlier work this paper cites.
Automatically constructing a corpus of sentential paraphrases
William B. Dolan and Chris Brockett. 2005 · 2005
Earlier work this paper cites.
Ontological foundations for structural conceptual models
Giancarlo Guizzardi. 2005 · 2005
Earlier work this paper cites.
A survey of named entity recognition and classification
David Nadeau and Satoshi Sekine. 2007 · 2007
Earlier work this paper cites.
Word sense disambiguation: A survey
Roberto Navigli. 2009 · 2009
Earlier work this paper cites.
A survey on explainability in machine reading comprehension
Mokanarangan Thayaparan, Marco Valentino, and André Freitas. 2020 · 2010
Earlier work this paper cites.
WordNet
Christiane Fellbaum. 2012 · 2012
Earlier work this paper cites.
The Stanford CoreNLP natural language processing toolkit
Christopher Manning, Mihai Surdeanu, John Bauer, Jenny Finkel, Steven Bethard, and David McClosky. 2014 · 2014
Earlier work this paper cites.
Ontology-alignment techniques: Survey and analysis
Fatima Ardjani, Djelloul Bouchiha, and Mimoun Malki. 2015 · 2015
Earlier work this paper cites.
A large annotated corpus for learning natural language inference
Samuel R. Bowman, Gabor Angeli, Christopher Potts, and Christopher D. Manning. 2015 · 2015
Cited alongside, same era.
Word tagging with foundational ontology classes: Extending the wordnet-dolce mapping to verbs
Vivian S. Silva, André Freitas, and Siegfried Handschuh. 2016 · 2016
Cited alongside, same era.
Fine-grained analysis of sentence embeddings using auxiliary prediction tasks
Yossi Adi, Einat Kermany, Yonatan Belinkov, Ofer Lavi, and Yoav Goldberg. 2017 · 2017
Cited alongside, same era.
Dieuwke Hupkes, Sara Veldhoen, and Willem Zuidema. 2018 · 2018
Cited alongside, same era.
A broad-coverage challenge corpus for sentence understanding through inference
Adina Williams, Nikita Nangia, and Samuel Bowman. 2018 · 2018
A systematic assessment of syntactic generalization in neural language models
Jennifer Hu, Jon Gauthier, Peng Qian, Ethan Wilcox, and Roger Levy. 2020 · 2020
Later among the works it cites.
Pareto probing: Trading off accuracy for complexity
Tiago Pimentel, Naomi Saphra, Adina Williams, and Ryan Cotterell. 2020a · 2020
Later among the works it cites.
Foundational ontologies meet ontology matching: A survey
Daniela Schmidt, Giancarlo Guizzardi, Adam Pease, Cassia Trojahn, and Renata Vieira. 2020 · 2020
Later among the works it cites.
Understanding pre-trained bert for aspect-based sentiment analysis
Hu Xu, Lei Shu, Philip S. Yu, and Bing Liu. 2020 · 2020
Later among the works it cites.
Probing classifiers: Promises, shortcomings, and advances
Yonatan Belinkov. 2021 · 2021
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
Language modeling teaches you more than translation does: Lessons learned through auxiliary syntactic task analysis
Kelly Zhang and Samuel Bowman. 2018 · 2018
Cited alongside, same era.
BERT: Pre-training of deep bidirectional transformers for language understanding
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019 · 2019
Cited alongside, same era.
Designing and interpreting probes with control tasks
John Hewitt and Percy Liang. 2019 · 2019
Cited alongside, same era.
Smart: Robust and efficient fine-tuning for pre-trained natural language models through principled regularized optimization
Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, and Tuo. Zhao. 2019 · 2019
Cited alongside, same era.
Probing biomedical embeddings from language models
Qiao Jin, Bhuwan Dhingra, William W. Cohen, and Xinghua Lu. 2019 · 2019
Cited alongside, same era.
Semantic role labeling with pretrained language models for known and unknown predicates
Daniil Larionov, Artem Shelmanov, Elena Chistova, and Ivan Smirnov. 2019 · 2019
Cited alongside, same era.
Sense vocabulary compression through the semantic knowledge of WordNet for neural word sense disambiguation
Loïc Vial, Benjamin Lecouteux, and Didier Schwab. 2019 · 2019
Cited alongside, same era.
Does my representation capture X? probe-ably
Deborah Ferreira, Julia Rozanova, Mokanarangan Thayaparan, Marco Valentino, and André Freitas. 2021 · 2021
Later among the works it cites.
Probing the probing paradigm: Does probing accuracy entail task relevance?
Abhilasha Ravichander, Yonatan Belinkov, and Eduard Hovy. 2021 · 2021
Later among the works it cites.
Explainable inference over grounding-abstract chains for science questions
Mokanarangan Thayaparan, Marco Valentino, and André Freitas. 2021 · 2021
Later among the works it cites.
Unification-based reconstruction of multi-hop explanations for science questions
Marco Valentino, Mokanarangan Thayaparan, and André Freitas. 2021 · 2021
Later among the works it cites.
Automated Concatenation of Embeddings for Structured Prediction
Xinyu Wang, Yong Jiang, Nguyen Bach, Tao Wang, Zhongqiang Huang, Fei Huang, and Kewei Tu. 2021 · 2021
Later among the works it cites.
Semantic role labeling as dependency parsing: Exploring latent tree structures inside arguments
Yu Zhang, Qingrong Xia, Shilin Zhou, Yong Jiang, Zhenghua Li, Guohong Fu, and Min Zhang. 2021 · 2021
Later among the works it cites.
Encoding explanatory knowledge for zero-shot science question answering
Zili Zhou, Marco Valentino, Donal Landers, and André Freitas. 2021 · 2021
Later among the works it cites.