How multilingual is Multilingual BERT?

Cross-lingual language model pretraining

Original

Guillaume Lample and Alexis Conneau. 2019 · 1901

Earlier work this paper cites.

Introduction to the CoNLL-2002 shared task: Language-independent named entity recognition

Erik F. Tjong Kim Sang. 2002 · 2002

Earlier work this paper cites.

Introduction to the CoNLL-2003 shared task: Language-independent named entity recognition

Erik F. Tjong Kim Sang and Fien De Meulder. 2003 · 2003

Earlier work this paper cites.

Selective sharing for multilingual dependency parsing

Tahira Naseem, Regina Barzilay, and Amir Globerson. 2012 · 2012

Earlier work this paper cites.

WALS Online

Matthew S. Dryer and Martin Haspelmath, editors. 2013 · 2013

Earlier work this paper cites.

Results of the WMT16 metrics shared task

Ondřej Bojar, Yvette Graham, Amir Kamran, and Miloš Stanojević. 2016 · 2016

Cited alongside, same era.

Neural architectures for named entity recognition

Guillaume Lample, Miguel Ballesteros, Sandeep Subramanian, Kazuya Kawakami, and Chris Dyer. 2016 · 2016

Cited alongside, same era.

Universal dependencies v1: A multilingual treebank collection

Joakim Nivre, Marie-Catherine de Marneffe, Filip Ginter, Yoav Goldberg, Jan Hajic, Christopher D. Manning, Ryan T. McDonald, Slav Petrov, Sampo Pyysalo, Natalia Silveira, Reut Tsarfaty, and Daniel Zeman. 2016 · 2016

Cited alongside, same era.

CoNLL 2017 shared task: Multilingual parsing from raw text to universal dependencies

Original

Daniel Zeman, Martin Popel, Milan Straka, Jan Hajic, Joakim Nivre, Filip Ginter, Juhani Luotolahti, Sampo Pyysalo, Slav Petrov, Martin Potthast, Francis Tyers, Elena Badmaeva, Memduh Gokirmak, Anna Nedoluzhko, Silvie Cinkova, Jan Hajic jr., Jaroslava Hlavacova, Václava Kettnerová, Zdenka Uresova, Jenna Kanerva, Stina Ojala, Anna Missilä, Christopher D. Manning, Sebastian Schuster, Siva Reddy, Dima Taji, Nizar Habash, Herman Leung, Marie-Catherine de Marneffe, Manuela Sanguinetti, Maria Simi, Hiroshi Kanayama, Valeria dePaiva, Kira Droganova, Héctor Martínez Alonso, Çağrı Çöltekin, Umut Sulubacak, Hans Uszkoreit, Vivien Macketanz, Aljoscha Burchardt, Kim Harris, Katrin Marheinecke, Georg Rehm, Tolga Kayadelen, Mohammed Attia, Ali Elkahky, Zhuoran Yu, Emily Pitler, Saran Lertpradit, Michael Mandl, Jesse Kirchner, Hector Fernandez Alcalde, Jana Strnadová, Esha Banerjee, Ruli Manurung, Antonio Stella, Atsuko Shimada, Sookyoung Kwak, Gustavo Mendonca, Tatiana Lando, Rattima Nitisaroj, and Josie Li. 2017 · 2017

Cited alongside, same era.

Dissecting contextual word embeddings: Architecture and representation

Matthew Peters, Mark Neumann, Luke Zettlemoyer, and Wen-tau Yih. 2018a

Cited in the paper.

Deep contextualized word representations

Matthew E. Peters, Mark Neumann, Mohit Iyyer, Matt Gardner, Christopher Clark, Kenton Lee, and Luke Zettlemoyer. 2018b

Cited in the paper.

BERT rediscovers the classical NLP pipeline

Ian Tenney, Dipanjan Das, and Ellie Pavlick. 2019a

Cited in the paper.

What do you learn from context? Probing for sentence structure in contextualized word representations

Ian Tenney, Patrick Xia, Berlin Chen, Alex Wang, Adam Poliak, R Thomas McCoy, Najoung Kim, Benjamin Van Durme, Sam Bowman, Dipanjan Das, and Ellie Pavlick. 2019b

Cited in the paper.

Massively multilingual sentence embeddings for zero-shot cross-lingual transfer and beyond

Original

Mikel Artetxe and Holger Schwenk. 2018 · 2018

Later among the works it cites.

Part-of-speech tagging for code-switched, transliterated texts without explicit language identification

Kelsey Ball and Dan Garrette. 2018 · 2018

Later among the works it cites.

Universal dependency parsing for Hindi-English code-switching

Irshad Bhat, Riyaz A. Bhat, Manish Shrivastava, and Dipti Sharma. 2018 · 2018

Later among the works it cites.

BERT: Pre-training of deep bidirectional transformers for language understanding

Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019 · 2019

Closest in time.