Fetching the paper…
Reading the bibliography…
Multi-lingual contextualized embeddings, such as multilingual-BERT (mBERT), have shown success in a variety of zero-shot cross-lingual tasks.
Inducing crosslingual distributed representations of words
Alexandre Klementiev, Ivan Titov, and Binod Bhattarai · 2012
Earlier work this paper cites.
PanLex: Building a resource for panlingual lexical translation
David Kamholz, Jonathan Pool, and Susan Colowick · 2014
Earlier work this paper cites.
Learning bilingual word representations by marginalizing alignments
Tomáš Kočiský, Karl Moritz Hermann, and Phil Blunsom · 2014
Earlier work this paper cites.
Normalized word embedding and orthogonal transform for bilingual word translation
Chao Xing, Dong Wang, Chao Liu, and Yiye Lin · 2015
Earlier work this paper cites.
A representation learning framework for multi-source transfer parsing
Jiang Guo, Wanxiang Che, David Yarowsky, Haifeng Wang, and Ting Liu · 2016
Earlier work this paper cites.
Semantic specialization of distributional word vector spaces using monolingual and cross-lingual constraints
Nikola Mrkšić, Ivan Vulić, Diarmuid Ó Séaghdha, Ira Leviant, Roi Reichart, Milica Gašić, Anna Korhonen, and Steve Young · 2017
Earlier work this paper cites.
A survey of cross-lingual word embedding models
Sebastian Ruder, Ivan Vulić, and Anders Søgaard · 2017
Earlier work this paper cites.
Massively multilingual sentence embeddings for zero-shot cross-lingual transfer and beyond
Mikel Artetxe and Holger Schwenk · 2018
Earlier work this paper cites.
Bilingual sentiment embeddings: Joint projection of sentiment across languages
Jeremy Barnes, Roman Klinger, and Sabine Schulte im Walde · 2018
Earlier work this paper cites.
Unsupervised multilingual word embeddings
Xilun Chen and Claire Cardie · 2018
Earlier work this paper cites.
XL-NBT: A cross-lingual neural belief tracking framework
Wenhu Chen, Jianshu Chen, Yu Su, Xin Wang, Dong Yu, Xifeng Yan, and William Yang Wang · 2018
Cited alongside, same era.
XNLI: Evaluating cross-lingual sentence representations
Alexis Conneau, Ruty Rinott, Guillaume Lample, Adina Williams, Samuel Bowman, Holger Schwenk, and Veselin Stoyanov · 2018
Cited alongside, same era.
Word translation without parallel data
Guillaume Lample, Alexis Conneau, Marc’Aurelio Ranzato, Ludovic Denoyer, and Hervé Jégou · 2018
Cited alongside, same era.
A corpus for multilingual document classification in eight languages
Holger Schwenk and Xian Li · 2018
Cited alongside, same era.
Multilingual seq2seq training with similarity loss for cross-lingual document classification
Katherine Yu, Haoran Li, and Barlas Oguz · 2018
Cited alongside, same era.
On the cross-lingual transferability of monolingual representations
Roberta: A robustly optimized bert pretraining approach
Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov · 2019
Later among the works it cites.
Attention-informed mixed-language training for zero-shot cross-lingual task-oriented dialogue systems, 2019
Zihan Liu, Genta Indra Winata, Zhaojiang Lin, Peng Xu, and Pascale Fung · 2019
Later among the works it cites.
Cross-lingual transfer learning for multilingual task oriented dialog
Sebastian Schuster, Sonal Gupta, Rushin Shah, and Mike Lewis · 2019
Later among the works it cites.
Cross-lingual alignment of contextual word embeddings, with applications to zero-shot dependency parsing
Tal Schuster, Ori Ram, Regina Barzilay, and Amir Globerson · 2019
Later among the works it cites.
Cross-lingual BERT transformation for zero-shot dependency parsing
Yuxuan Wang, Wanxiang Che, Jiang Guo, Yijia Liu, and Ting Liu · 2019
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Mikel Artetxe, Sebastian Ruder, and Dani Yogatama · 2019
Cited alongside, same era.
Cross-lingual language model pretraining
Alexis Conneau and Guillaume Lample · 2019
Cited alongside, same era.
BERT: Pre-training of deep bidirectional transformers for language understanding
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova · 2019
Cited alongside, same era.
Unicoder: A universal language encoder by pre-training with multiple cross-lingual tasks
Haoyang Huang, Yaobo Liang, Nan Duan, Ming Gong, Linjun Shou, Daxin Jiang, and Ming Zhou · 2019
Cited alongside, same era.
Beto, bentz, becas: The surprising cross-lingual effectiveness of BERT
Shijie Wu and Mark Dredze · 2019
Later among the works it cites.
Dialog state tracking with reinforced data augmentation
Yichun Yin, Lifeng Shang, Xin Jiang, Xiao Chen, and Qun Liu · 2019
Later among the works it cites.
Cross-lingual dependency parsing using code-mixed TreeBank
Meishan Zhang, Yue Zhang, and Guohong Fu · 2019
Later among the works it cites.
Emerging cross-lingual structure in pretrained language models
Alexis Conneau, Shijie Wu, Haoran Li, Luke Zettlemoyer, and Veselin Stoyanov · 2020
Closest in time.