Data Augmentation for Neural Machine Translation using Generative Language Model

Language models are few-shot learners

Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel Ziegler, Jeffrey Wu, Clemens Winter, Chris Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei. 2020 · 1901

Earlier work this paper cites.

Improving neural machine translation models with monolingual data

Rico Sennrich, Barry Haddow, and Alexandra Birch. 2016 · 2016

Earlier work this paper cites.

Understanding back-translation at scale

Sergey Edunov, Myle Ott, Michael Auli, and David Grangier. 2018 · 2018

Earlier work this paper cites.

Iterative back-translation for neural machine translation

Vu Cong Duy Hoang, Philipp Koehn, Gholamreza Haffari, and Trevor Cohn. 2018 · 2018

Earlier work this paper cites.

A call for clarity in reporting BLEU scores

Matt Post. 2018 · 2018

Earlier work this paper cites.

Massively multilingual sentence embeddings for zero-shot cross-lingual transfer and beyond

Mikel Artetxe and Holger Schwenk. 2019 · 2019

Cited alongside, same era.

Decoupled weight decay regularization

Ilya Loshchilov and Frank Hutter. 2019 · 2019

Cited alongside, same era.

Data augmentation using back-translation for context-aware neural machine translation

Amane Sugiyama and Naoki Yoshinaga. 2019 · 2019

Cited alongside, same era.

Data augmentation using pre-trained transformer models

Varun Kumar, Ashutosh Choudhary, and Eunah Cho. 2020 · 2020

Cited alongside, same era.

Domain robustness in neural machine translation

Mathias Müller, Annette Rios, and Rico Sennrich. 2020 · 2020

Later among the works it cites.

Multilingual translation with extensible multilingual pretraining and finetuning

Original

Yuqing Tang, Chau Tran, Xian Li, Peng-Jen Chen, Naman Goyal, Vishrav Chaudhary, Jiatao Gu, and Angela Fan. 2020 · 2020

Later among the works it cites.

On exposure bias, hallucination and domain shift in neural machine translation

Chaojun Wang and Rico Sennrich. 2020 · 2020

Later among the works it cites.

GPT3Mix: Leveraging large-scale language models for text augmentation

Original

Kang Min Yoo, Dongju Park, Jaewook Kang, Sang-Woo Lee, and Woomyoung Park. 2021 · 2021

Later among the works it cites.