Fetching the paper…
Reading the bibliography…
Linguistic analysis of language models is one of the ways to explain and describe their reasoning, weaknesses, and limitations.
Beto, bentz, becas: The surprising cross-lingual effectiveness of bert
Shijie Wu and Mark Dredze. 2019 · 1904
Earlier work this paper cites.
How multilingual is multilingual bert?
Telmo Pires, Eva Schlinger, and Dan Garrette. 2019 · 1906
Earlier work this paper cites.
Designing and interpreting probes with control tasks
John Hewitt and Percy Liang. 2019 · 1909
Earlier work this paper cites.
Allennlp interpret: A framework for explaining predictions of nlp models
Eric Wallace, Jens Tuyls, Junlin Wang, Sanjay Subramanian, Matt Gardner, and Sameer Singh. 2019 · 1909
Earlier work this paper cites.
Unsupervised cross-lingual representation learning at scale
Alexis Conneau, Kartikay Khandelwal, Naman Goyal, Vishrav Chaudhary, Guillaume Wenzek, Francisco Guzmán, Edouard Grave, Myle Ott, Luke Zettlemoyer, and Veselin Stoyanov. 2019 · 1911
Earlier work this paper cites.
The european linguistic area: Standard average european
Martin Haspelmath. 2001 · 2001
Earlier work this paper cites.
Evidentiality. oxford: Oxford university press, 2004
Alexandra Y Aikhenvald. 2006 · 2004
Earlier work this paper cites.
Finding universal grammatical relations in multilingual bert
Ethan A Chi, John Hewitt, and Christopher D Manning. 2020 · 2005
Earlier work this paper cites.
What, if anything, is typology?
Johanna Nichols. 2007 · 2007
Earlier work this paper cites.
Fixing weight decay regularization in adam
Ilya Loshchilov and Frank Hutter. 2017 · 2017
Earlier work this paper cites.
Senteval: An evaluation toolkit for universal sentence representations
Alexis Conneau and Douwe Kiela. 2018 · 2018
Cited alongside, same era.
Bert: Pre-training of deep bidirectional transformers for language understanding
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018 · 2018
Cited alongside, same era.
Neurox: A toolkit for analyzing individual neurons in neural networks
Fahim Dalvi, Avery Nortonsmith, D. Anthony Bau, Yonatan Belinkov, Hassan Sajjad, Nadir Durrani, and James Glass. 2019 · 2019
Cited alongside, same era.
What does BERT learn about the structure of language?
Ganesh Jawahar, Benoît Sagot, and Djamé Seddah. 2019 · 2019
Cited alongside, same era.
Probing word and sentence embeddings for long-distance dependencies effects in French and English
Paola Merlo. 2019 · 2019
Cited alongside, same era.
Pre-training with whole word masking for chinese BERT
Yiming Cui, Wanxiang Che, Ting Liu, Bing Qin, and Ziqing Yang. 2021 · 2021
Later among the works it cites.
Universal Dependencies
Marie-Catherine de Marneffe, Christopher D. Manning, Joakim Nivre, and Daniel Zeman. 2021 · 2021
Later among the works it cites.
Not all models localize linguistic knowledge in the same place: A layer-wise probing on BERToids’ representations
Mohsen Fayyaz, Ehsan Aghazadeh, Ali Modarressi, Hosein Mohebbi, and Mohammad Taher Pilehvar. 2021 · 2021
Later among the works it cites.
Discourse probing of pretrained language models
Fajri Koto, Jey Han Lau, and Tim Baldwin. 2021 · 2021
Later among the works it cites.
Probing multilingual language models for discourse
Murathan Kurfalı and Robert Östling. 2021 · 2021
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Probing multilingual sentence representations with X-probe
Vinit Ravishankar, Lilja Øvrelid, and Erik Velldal. 2019b · 2019
Cited alongside, same era.
Linspector: Multilingual probing tasks for word representations
Gözde Gül Şahin, Clara Vania, Ilia Kuznetsov, and Iryna Gurevych. 2019 · 2019
Cited alongside, same era.
exbert: A visual analysis tool to explore learned representations in transformer models
Benjamin Hoover, Hendrik Strobelt, and Sebastian Gehrmann. 2020 · 2020
Cited alongside, same era.
A primer in BERTology: What we know about how BERT works
Anna Rogers, Olga Kovaleva, and Anna Rumshisky. 2020 · 2020
Cited alongside, same era.
Linspector: Multilingual probing tasks for word representations
Gözde Gül Sahin, Clara Vania, Ilia Kuznetsov, and Iryna Gurevych. 2020 · 2020
Cited alongside, same era.
Probing multilingual sentence representations with x-probe
Vinit Ravishankar, Lilja Øvrelid, and Erik Velldal. 2019a
Cited in the paper.
Andreas Madsen, Siva Reddy, and A. P. Sarath Chandar. 2021 · 2021
Later among the works it cites.
RuSentEval: Linguistic source, encoder force!
Vladislav Mikhailov, Ekaterina Taktasheva, Elina Sigdel, and Ekaterina Artemova. 2021 · 2021
Later among the works it cites.
Probing classifiers: Promises, shortcomings, and advances
Yonatan Belinkov. 2022 · 2022
Closest in time.
Ad astra or astray: Exploring linguistic knowledge of multilingual bert through nli task
Maria Tikhonova, Vladislav Mikhailov, Dina Pisarevskaya, Valentin Malykh, and Tatiana Shavrina. 2022 · 2022
Closest in time.
Is neural language acquisition similar to natural?a chronological probing study
Ekaterina Voloshina, Oleg Serikov, and Tatiana Shavrina. 2022 · 2022
Closest in time.