Extending Multilingual BERT to Low-Resource Languages

Roberta: A robustly optimized bert pretraining approach

Original

Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019 · 1907

Earlier work this paper cites.

Improving vector space word representations using multilingual correlation

Manaal Faruqui and Chris Dyer. 2014 · 2014

Earlier work this paper cites.

Neural architectures for named entity recognition

Guillaume Lample, Miguel Ballesteros, Sandeep Subramanian, Kazuya Kawakami, and Chris Dyer. 2016 · 2016

Earlier work this paper cites.

End-to-end sequence labeling via bi-directional LSTM-CNNs-CRF

Xuezhe Ma and Eduard Hovy. 2016 · 2016

Earlier work this paper cites.

Lorelei language packs: Data, tools, and resources for technology development in low resource languages

Stephanie Strassel and Jennifer Tracey. 2016 · 2016

Earlier work this paper cites.

A robust self-learning method for fully unsupervised cross-lingual mappings of word embeddings

Mikel Artetxe, Gorka Labaka, and Eneko Agirre. 2018 · 2018

Earlier work this paper cites.

Multilingual bert - r

Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018 · 2018

Cited alongside, same era.

AllenNLP: A deep semantic natural language processing platform

Matt Gardner, Joel Grus, Mark Neumann, Oyvind Tafjord, Pradeep Dasigi, Nelson F. Liu, Matthew Peters, Michael Schmitz, and Luke Zettlemoyer. 2018 · 2018

Cited alongside, same era.

Word translation without parallel data

Guillaume Lample, Alexis Conneau, Marc’Aurelio Ranzato, Ludovic Denoyer, and Hervé Jégou. 2018 · 2018

Cited alongside, same era.

Massively multilingual sentence embeddings for zero-shot cross-lingual transfer and beyond

Mikel Artetxe and Holger Schwenk. 2019 · 2019

Cited alongside, same era.

Cross-lingual language model pretraining

Alexis Conneau and Guillaume Lample. 2019 · 2019

Cited alongside, same era.

BERT: Pre-training of deep bidirectional transformers for language understanding

Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019 · 2019

Later among the works it cites.

How multilingual is multilingual BERT?

Telmo Pires, Eva Schlinger, and Dan Garrette. 2019 · 2019

Later among the works it cites.

Cross-lingual transfer learning for multilingual task oriented dialog

Sebastian Schuster, Sonal Gupta, Rushin Shah, and Mike Lewis. 2019 · 2019

Later among the works it cites.

Beto, bentz, becas: The surprising cross-lingual effectiveness of BERT

Shijie Wu and Mark Dredze. 2019 · 2019

Later among the works it cites.

Cross-lingual ability of multilingual bert: An empirical study

K Karthikeyan, Zihan Wang, Stephen Mayhew, and Dan Roth. 2020 · 2020

Closest in time.