Fetching the paper…
Reading the bibliography…
To what extent do pre-trained language models grasp semantic knowledge regarding the phenomenon of distributivity? In this paper, we introduce DistNLI, a new diagnostic dataset for natural language inference that targets the semantic difference arising from distributivity, and employ the causal mediation analysis framework to quantify the model behavior and explore the underlying mechanism in this semantically-related task.
Roberta: A robustly optimized bert pretraining approach
Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019 · 1907
Earlier work this paper cites.
The semantics of scope in English
Anthony S Kroch. 1974 · 1974
Earlier work this paper cites.
Collective, distributive and cumulative quantification
Remko Scha. 1981 · 1981
Earlier work this paper cites.
Collective predicates, distributive predicates, and all
David Dowty et al. 1987 · 1987
Earlier work this paper cites.
Modal subordination, anaphora, and distributivity
Craige Roberts. 1987 · 1987
Earlier work this paper cites.
Binominal each
Ken Safir and Tim Stowell. 1987 · 1987
Earlier work this paper cites.
The semantics of non-boolean “and”
Jack Hoeksema. 1988 · 1988
Earlier work this paper cites.
Collective predicates, aktionsarten and all
Alison Taub. 1989 · 1989
Earlier work this paper cites.
Identifiability and exchangeability for direct and indirect effects
James M Robins and Sander Greenland. 1992 · 1992
Earlier work this paper cites.
Distributivity and collectivity: a couple at odds
Henk Verkuyl. 1993 · 1993
Earlier work this paper cites.
Plurality, conjunction, and events, vol. 55 of
Peter Lasersohn. 1995 · 1995
Earlier work this paper cites.
Choice functions and the scopal semantics of indefinites
Yoad Winter. 1997 · 1997
Earlier work this paper cites.
Direct and indirect effects
Judea Pearl. 2001 · 2001
Earlier work this paper cites.
The logical analysis of plurals and mass terms: A lattice-theoretical approach
Godehard Link et al. 2002 · 2002
Cited alongside, same era.
Causal mediation analysis for interpreting neural nlp: The case of gender bias
Jesse Vig, Sebastian Gehrmann, Yonatan Belinkov, Sharon Qian, Daniel Nevo, Yaron Singer, and Stuart M. Shieber. 2020a · 2004
Cited alongside, same era.
Explaining odds ratios
Magdalena Szumilas. 2010 · 2010
Cited alongside, same era.
Odds ratios for mediation analysis for a dichotomous outcome
Tyler J. VanderWeele and Stijn Vansteelandt. 2010 · 2010
Cited alongside, same era.
A large annotated corpus for learning natural language inference
Samuel R. Bowman, Gabor Angeli, Christopher Potts, and Christopher D. Manning. 2015a · 2015
Cited alongside, same era.
Parts of a whole: Distributivity as a bridge between aspect and measurement , volume 66
What does BERT learn about the structure of language?
Ganesh Jawahar, Benoît Sagot, and Djamé Seddah. 2019 · 2019
Later among the works it cites.
Right for the wrong reasons: Diagnosing syntactic heuristics in natural language inference
Tom McCoy, Ellie Pavlick, and Tal Linzen. 2019 · 2019
Later among the works it cites.
Sentence-BERT: Sentence embeddings using Siamese BERT-networks
Nils Reimers and Iryna Gurevych. 2019 · 2019
Later among the works it cites.
What do you learn from context? probing for sentence structure in contextualized word representations
Ian Tenney, Patrick Xia, Berlin Chen, Alex Wang, Adam Poliak, R Thomas McCoy, Najoung Kim, Benjamin Van Durme, Sam Bowman, Dipanjan Das, and Ellie Pavlick. 2019 · 2019
Later among the works it cites.
What BERT is not: Lessons from a new suite of psycholinguistic diagnostics for language models
Allyson Ettinger. 2020 · 2020
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Lucas Champollion. 2017 · 2017
Cited alongside, same era.
Enhanced LSTM for natural language inference
Qian Chen, Xiaodan Zhu, Zhen-Hua Ling, Si Wei, Hui Jiang, and Diana Inkpen. 2017 · 2017
Cited alongside, same era.
Two kinds of distributivity
Hanna De Vries. 2017 · 2017
Cited alongside, same era.
XNLI: Evaluating cross-lingual sentence representations
Alexis Conneau, Ruty Rinott, Guillaume Lample, Adina Williams, Samuel Bowman, Holger Schwenk, and Veselin Stoyanov. 2018 · 2018
Cited alongside, same era.
DR-BiLSTM: Dependent reading bidirectional LSTM for natural language inference
Reza Ghaeini, Sadid A. Hasan, Vivek Datla, Joey Liu, Kathy Lee, Ashequl Qadir, Yuan Ling, Aaditya Prakash, Xiaoli Fern, and Oladimeji Farri. 2018 · 2018
Cited alongside, same era.
A broad-coverage challenge corpus for sentence understanding through inference
Adina Williams, Nikita Nangia, and Samuel Bowman. 2018 · 2018
Cited alongside, same era.
Invitation to formal semantics
Elizabeth Coppock and Lucas Champollion. 2019 · 2019
Cited alongside, same era.
Cross-lingual ability of multilingual bert: An empirical study
Karthikeyan K, Zihan Wang, Stephen Mayhew, and Dan Roth. 2020 · 2020
Later among the works it cites.
ConjNLI: Natural language inference over conjunctive sentences
Swarnadeep Saha, Yixin Nie, and Mohit Bansal. 2020 · 2020
Later among the works it cites.
Probing classifiers: Promises, shortcomings, and advances
Yonatan Belinkov. 2021 · 2021
Later among the works it cites.
Investigating negation in pre-trained vision-and-language models
Radina Dobreva and Frank Keller. 2021 · 2021
Later among the works it cites.
Causal analysis of syntactic agreement mechanisms in neural language models
Matthew Finlayson, Aaron Mueller, Sebastian Gehrmann, Stuart Shieber, Tal Linzen, and Yonatan Belinkov. 2021 · 2021
Later among the works it cites.
Deberta: Decoding-enhanced bert with disentangled attention
Pengcheng He, Xiaodong Liu, Jianfeng Gao, and Weizhu Chen. 2021 · 2021
Later among the works it cites.
Language models use monotonicity to assess NPI licensing
Jaap Jumelet, Milica Denic, Jakub Szymanik, Dieuwke Hupkes, and Shane Steinert-Threlkeld. 2021 · 2021
Later among the works it cites.
What changed? investigating debiasing methods using causal mediation analysis
Sullam Jeoung and Jana Diesner. 2022 · 2022
Closest in time.