Cross-lingual Supervision Improves Unsupervised Neural Machine Translation

Cross-lingual language model pretraining

Original

Guillaume Lample and Alexis Conneau. 2019 · 1901

Earlier work this paper cites.

A teacher-student framework for zero-resource neural machine translation

Yun Chen, Yang Liu, Yong Cheng, and Victor O.K. Li. 2017 · 1935

Earlier work this paper cites.

Multilingual denoising pre-training for neural machine translation

Original

Yinhan Liu, Jiatao Gu, Naman Goyal, Xian Li, Sergey Edunov, Marjan Ghazvininejad, Mike Lewis, and Luke Zettlemoyer. 2020 · 2001

Earlier work this paper cites.

Pre-training multilingual neural machine translation by leveraging alignment information

Original

Zehui Lin, Xiao Pan, Mingxuan Wang, Xipeng Qiu, Jiangtao Feng, Hao Zhou, and Lei Li. 2020 · 2010

Earlier work this paper cites.

Neural machine translation by jointly learning to align and translate

Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2015 · 2015

Earlier work this paper cites.

Zero-resource translation with multi-lingual neural machine translation

Orhan Firat, Baskaran Sankaran, Yaser Al-onaizan, Fatos T. Yarman Vural, and Kyunghyun Cho. 2016 · 2016

Earlier work this paper cites.

Dual learning for machine translation

Di He, Yingce Xia, Tao Qin, Liwei Wang, Nenghai Yu, Tie-Yan Liu, and Wei-Ying Ma. 2016 · 2016

Earlier work this paper cites.

Improving neural machine translation models with monolingual data

Rico Sennrich, Barry Haddow, and Alexandra Birch. 2016 · 2016

Earlier work this paper cites.

Learning bilingual word embeddings with (almost) no bilingual data

Mikel Artetxe, Gorka Labaka, and Eneko Agirre. 2017 · 2017

Earlier work this paper cites.

Convolutional sequence to sequence learning

Jonas Gehring, Michael Auli, David Grangier, Denis Yarats, and Yann N. Dauphin. 2017 · 2017

Cited alongside, same era.

Google’s multilingual neural machine translation system: Enabling zero-shot translation

Melvin Johnson, Mike Schuster, Quoc V. Le, Maxim Krikun, Yonghui Wu, Zhifeng Chen, Nikhil Thorat, Fernanda Viégas, Martin Wattenberg, Greg Corrado, Macduff Hughes, and Jeffrey Dean. 2017 · 2017

Cited alongside, same era.

Attention is all you need

Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Ł ukasz Kaiser, and Illia Polosukhin. 2017 · 2017

Cited alongside, same era.

Maximum expected likelihood estimation for zero-resource neural machine translation

Hao Zheng, Yong Cheng, and Yang Liu. 2017 · 2017

Cited alongside, same era.

Unsupervised statistical machine translation

Mikel Artetxe, Gorka Labaka, and Eneko Agirre. 2018a · 2018

Cited alongside, same era.

Understanding back-translation at scale

Dual transfer learning for neural machine translation with marginal distribution regularization

Yijun Wang, Yingce Xia, Li Zhao, Jiang Bian, Tao Qin, Guiquan Liu, and Tie-Yan Liu. 2018 · 2018

Later among the works it cites.

Consistency by agreement in zero-shot neural machine translation

Maruan Al-Shedivat and Ankur Parikh. 2019 · 2019

Later among the works it cites.

An effective approach to unsupervised machine translation

Mikel Artetxe, Gorka Labaka, and Eneko Agirre. 2019 · 2019

Later among the works it cites.

Unsupervised neural machine translation with smt as posterior regularization

Shuo Ren, Zhirui Zhang, Shujie Liu, Ming Zhou, and Shuai Ma. 2019 · 2019

Later among the works it cites.

MASS: Masked sequence to sequence pre-training for language generation

Kaitao Song, Xu Tan, Tao Qin, Jianfeng Lu, and Tie-Yan Liu. 2019 · 2019

Later among the works it cites.

Multi-agent dual learning