Pretrained Language Models for Document-Level Neural Machine Translation

Wit3: Web inventory of transcribed and translated talks

Mauro Cettolo, Christian Girardi, and Marcello Federico. 2012 · 2012

Earlier work this paper cites.

Adam: A method for stochastic optimization

Diederik P. Kingma and Jimmy Ba. 2015 · 2015

Earlier work this paper cites.

Google’s neural machine translation system: Bridging the gap between human and machine translation

Original

Yonghui Wu, Mike Schuster, Zhifeng Chen, Quoc V. Le, Mohammad Norouzi, Wolfgang Macherey, Maxim Krikun, Yuan Cao, Qin Gao, Klaus Macherey, Jeff Klingner, Apurva Shah, Melvin Johnson, Xiaobing Liu, Łukasz Kaiser, Stephan Gouws, Yoshikiyo Kato, Taku Kudo, Hideto Kazawa, Keith Stevens, George Kurian, Nishant Patil, Wei Wang, Cliff Young, Jason Smith, Jason Riesa, Alex Rudnick, Oriol Vinyals, Greg Corrado, Macduff Hughes, and Jeffrey Dean. 2016 · 2016

Earlier work this paper cites.

Does neural machine translation benefit from larger context?

Original

Sebastien Jean, Stanislas Lauly, Orhan Firat, and Kyunghyun Cho. 2017 · 2017

Earlier work this paper cites.

Unsupervised pretraining for sequence to sequence learning

Prajit Ramachandran, Peter Liu, and Quoc Le. 2017 · 2017

Earlier work this paper cites.

Neural machine translation with extended context

Jörg Tiedemann and Yves Scherrer. 2017 · 2017

Cited alongside, same era.

Attention is all you need

Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Ł ukasz Kaiser, and Illia Polosukhin. 2017 · 2017

Cited alongside, same era.

Exploiting cross-sentence context for neural machine translation

Longyue Wang, Zhaopeng Tu, Andy Way, and Qun Liu. 2017 · 2017

Cited alongside, same era.

Bert: Pre-training of deep bidirectional transformers for language understanding

Original

Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018 · 2018

Cited alongside, same era.

Modeling coherence for neural machine translation with dynamic and topic caches

Shaohui Kuang, Deyi Xiong, Weihua Luo, and Guodong Zhou. 2018 · 2018

Cited alongside, same era.

Document-level neural machine translation with hierarchical attention networks

Lesly Miculicich, Dhananjay Ram, Nikolaos Pappas, and James Henderson. 2018 · 2018

Later among the works it cites.

Learning to remember translation history with a continuous cache

Zhaopeng Tu, Yang Liu, Shuming Shi, and Tong Zhang. 2018 · 2018

Later among the works it cites.

Context-aware neural machine translation learns anaphora resolution

Elena Voita, Pavel Serdyukov, Rico Sennrich, and Ivan Titov. 2018 · 2018

Later among the works it cites.

Improving the transformer translation model with document-level context

Jiacheng Zhang, Huanbo Luan, Maosong Sun, Feifei Zhai, Jingfang Xu, Min Zhang, and Yang Liu. 2018 · 2018

Later among the works it cites.

Transformer-XL: Attentive language models beyond a fixed-length context

Zihang Dai, Zhilin Yang, Yiming Yang, Jaime Carbonell, Quoc Le, and Ruslan Salakhutdinov. 2019 · 2019

Closest in time.