Fetching the paper…
Reading the bibliography…
The emergent cross-lingual transfer seen in multilingual pretrained models has sparked significant interest in studying their behavior.
Cross-lingual language model pretraining
Guillaume Lample and Alexis Conneau. 2019 · 1901
Earlier work this paper cites.
How language-neutral is multilingual bert?
Jindřich Libovickỳ, Rudolf Rosa, and Alexander Fraser. 2019 · 1911
Earlier work this paper cites.
Improved statistical alignment models
Franz Josef Och and Hermann Ney. 2000 · 2000
Earlier work this paper cites.
Europarl: A parallel corpus for statistical machine translation
Philipp Koehn. 2005 · 2005
Earlier work this paper cites.
Automatic Alignment of Tectogrammatical Trees from Czech-English Parallel Corpus
David Mareček. 2008 · 2008
Earlier work this paper cites.
Phrase alignments in parallel corpus using bootstrapping approach
Leila Tavakoli and Heshaam Faili. 2014 · 2014
Earlier work this paper cites.
Learning language representations for typology prediction
Chaitanya Malaviya, Graham Neubig, and Patrick Littell. 2017 · 2017
Earlier work this paper cites.
Conll 2017 shared task: Multilingual parsing from raw text to universal dependencies
Daniel Zeman, Martin Popel, Milan Straka, Jan Hajic, Joakim Nivre, Filip Ginter, Juhani Luotolahti, Sampo Pyysalo, Slav Petrov, Martin Potthast, et al. 2017 · 2017
Earlier work this paper cites.
Deep RNNs encode soft hierarchical syntax
Terra Blevins, Omer Levy, and Luke Zettlemoyer. 2018 · 2018
Earlier work this paper cites.
XNLI: Evaluating cross-lingual sentence representations
Alexis Conneau, Ruty Rinott, Guillaume Lample, Adina Williams, Samuel Bowman, Holger Schwenk, and Veselin Stoyanov. 2018 · 2018
Earlier work this paper cites.
Multilingual BERT Readme
Jacob Delvin. 2019 · 2019
Earlier work this paper cites.
75 languages, 1 model: Parsing universal dependencies universally
Dan Kondratyuk and Milan Straka. 2019 · 2019
Earlier work this paper cites.
Linguistic knowledge and transferability of contextual representations
Nelson F. Liu, Matt Gardner, Yonatan Belinkov, Matthew E. Peters, and Noah A. Smith. 2019 · 2019
Earlier work this paper cites.
fairseq: A fast, extensible toolkit for sequence modeling
Myle Ott, Sergey Edunov, Alexei Baevski, Angela Fan, Sam Gross, Nathan Ng, David Grangier, and Michael Auli. 2019 · 2019
Cited alongside, same era.
How multilingual is multilingual bert?
Telmo Pires, Eva Schlinger, and Dan Garrette. 2019 · 2019
Cited alongside, same era.
Bert is not an interlingua and the bias of tokenization
Jasdeep Singh, Bryan McCann, Richard Socher, and Caiming Xiong. 2019 · 2019
Cited alongside, same era.
Interpretability and analysis in neural NLP
Yonatan Belinkov, Sebastian Gehrmann, and Ellie Pavlick. 2020 · 2020
Cited alongside, same era.
Finding universal grammatical relations in multilingual bert
Ethan A Chi, John Hewitt, and Christopher D Manning. 2020 · 2020
Cited alongside, same era.
Pretrained language model embryology: The birth of albert
Cheng-Han Chiang, Sung-Feng Huang, and Hung-Yi Lee. 2020 · 2020
Simalign: High quality word alignments without parallel training data using static and contextualized embeddings
Masoud Jalili Sabet, Philipp Dufter, François Yvon, and Hinrich Schütze. 2020 · 2020
Later among the works it cites.
On negative interference in multilingual models: Findings and a meta-learning treatment
Zirui Wang, Zachary C Lipton, and Yulia Tsvetkov. 2020 · 2020
Later among the works it cites.
Are all languages created equal in multilingual bert?
Shijie Wu and Mark Dredze. 2020 · 2020
Later among the works it cites.
When is bert multilingual? isolating crucial ingredients for cross-lingual transfer
Ameet Deshpande, Partha Talukdar, and Karthik Narasimhan. 2021 · 2021
Later among the works it cites.
Few-shot learning with multilingual language models
Xi Victoria Lin, Todor Mihaylov, Mikel Artetxe, Tianlu Wang, Shuohui Chen, Daniel Simig, Myle Ott, Naman Goyal, Shruti Bhosale, Jingfei Du, et al. 2021 · 2021
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
What’s so special about bert’s layers? a closer look at the nlp pipeline in monolingual and multilingual models
Wietse de Vries, Andreas van Cranenburgh, and Malvina Nissim. 2020 · 2020
Cited alongside, same era.
Identifying elements essential for bert’s multilinguality
Philipp Dufter and Hinrich Schütze. 2020 · 2020
Cited alongside, same era.
It’s not greek to mbert: Inducing word-level translations from multilingual bert
Hila Gonen, Shauli Ravfogel, Yanai Elazar, and Yoav Goldberg. 2020 · 2020
Cited alongside, same era.
Xtreme: A massively multilingual multi-task benchmark for evaluating cross-lingual generalisation
Junjie Hu, Sebastian Ruder, Aditya Siddhant, Graham Neubig, Orhan Firat, and Melvin Johnson. 2020 · 2020
Cited alongside, same era.
Cross-lingual ability of multilingual bert: An empirical study
Karthikeyan K, Zihan Wang, Stephen Mayhew, and Dan Roth. 2020 · 2020
Cited alongside, same era.
From zero to hero: On the limitations of zero-shot language transfer with multilingual transformers
Anne Lauscher, Vinit Ravishankar, Ivan Vulić, and Goran Glavaš. 2020 · 2020
Cited alongside, same era.
Later among the works it cites.
Probing across time: What does roberta know and when?
Zeyu Liu, Yizhong Wang, Jungo Kasai, Hannaneh Hajishirzi, and Noah A Smith. 2021 · 2021
Later among the works it cites.
First align, then predict: Understanding the cross-lingual ability of multilingual bert
Benjamin Muller, Yanai Elazar, Benoît Sagot, and Djamé Seddah. 2021 · 2021
Later among the works it cites.
Deep subjecthood: Higher-order grammatical features in multilingual bert
Isabel Papadimitriou, Ethan A Chi, Richard Futrell, and Kyle Mahowald. 2021 · 2021
Later among the works it cites.
Xl-wsd: An extra-large and cross-lingual evaluation framework for word sense disambiguation
Tommaso Pasini, Alessandro Raganato, Roberto Navigli, et al. 2021 · 2021
Later among the works it cites.
How much pretraining data do language models need to learn syntax?
Laura Pérez-Mayos, Miguel Ballesteros, and Leo Wanner. 2021 · 2021
Later among the works it cites.
Shaking syntactic trees on the sesame street: Multilingual probing with controllable perturbations
Ekaterina Taktasheva, Vladislav Mikhailov, and Ekaterina Artemova. 2021 · 2021
Later among the works it cites.
Revisiting the primacy of english in zero-shot cross-lingual transfer
Iulia Turc, Kenton Lee, Jacob Eisenstein, Ming-Wei Chang, and Kristina Toutanova. 2021 · 2021
Later among the works it cites.
The grammar-learning trajectories of neural language models
Leshem Choshen, Guy Hacohen, Daphna Weinshall, and Omri Abend. 2022 · 2022
Closest in time.