2022

Towards Robust k-Nearest-Neighbor Machine Translation

Jiang, Hui, Lu, Ziyao, Meng, Fandong et al.

Understand

k-Nearest-Neighbor Machine Translation (kNN-MT) becomes an important research direction of NMT in recent years.

Its main idea is to retrieve useful key-value pairs from an additional datastore to modify translations without updating the NMT model.
However, the underlying retrieved noisy pairs will dramatically deteriorate the model performance.
In this paper, we conduct a preliminary study and find that this problem results from not fully exploiting the prediction of the NMT model.

Built on

Non-parametric adaptation for neural machine translation
Ankur Bapna and Orhan Firat. 2019 · 1931
Earlier work this paper cites.
Statistical significance tests for machine translation evaluation
Philipp Koehn. 2004 · 2004
Earlier work this paper cites.
Translation model adaptation for statistical machine translation with monolingual topic information
Jinsong Su, Hua Wu, Haifeng Wang, Yidong Chen, Xiaodong Shi, Huailin Dong, and Qun Liu. 2012 · 2012
Earlier work this paper cites.
A topic-triggered language model for statistical machine translation
Heng Yu, Jinsong Su, Yajuan Lv, and Qun Liu. 2013 · 2013
Earlier work this paper cites.
A context-aware topic model for statistical machine translation
Jinsong Su, Deyi Xiong, Yang Liu, Xianpei Han, Hongyu Lin, Junfeng Yao, and Min Zhang. 2015 · 2015
Earlier work this paper cites.
Neural machine translation of rare words with subword units
Rico Sennrich, Barry Haddow, and Alexandra Birch. 2016 · 2016
Earlier work this paper cites.
Six challenges for neural machine translation
Philipp Koehn and Rebecca Knowles. 2017 · 2017
Earlier work this paper cites.
Attention is all you need
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Ł ukasz Kaiser, and Illia Polosukhin. 2017 · 2017
Earlier work this paper cites.
Towards robust neural machine translation
Yong Cheng, Zhaopeng Tu, Fandong Meng, Junjie Zhai, and Yang Liu. 2018 · 2018
Earlier work this paper cites.
A call for clarity in reporting BLEU scores
Matt Post. 2018 · 2018
Earlier work this paper cites.

Similar

Context-aware phrase representation for statistical machine translation
Zhiwei Ruan, Jinsong Su, Deyi Xiong, and Rongrong Ji. 2018 · 2018
Cited alongside, same era.
Learning to remember translation history with a continuous cache
Zhaopeng Tu, Yang Liu, Shuming Shi, and Tong Zhang. 2018 · 2018
Cited alongside, same era.
Guiding neural machine translation with retrieved translation pieces
Jingyi Zhang, Masao Utiyama, Eiichiro Sumita, Graham Neubig, and Satoshi Nakamura. 2018 · 2018
Cited alongside, same era.
Neural fuzzy repair: Integrating fuzzy matches into neural machine translation
Bram Bulté and Arda Tezcan. 2019 · 2019
Cited alongside, same era.
Robust neural machine translation with doubly adversarial inputs
Yong Cheng, Lu Jiang, and Wolfgang Macherey. 2019 · 2019
Cited alongside, same era.
Facebook fair’s WMT19 news translation task submission
Nathan Ng, Kyra Yee, Alexei Baevski, Myle Ott, Michael Auli, and Sergey Edunov. 2019 · 2019
Cited alongside, same era.
Graph based translation memory for neural machine translation
Mengzhou Xia, Guoping Huang, Lemao Liu, and Shuming Shi. 2019 · 2019
Cited alongside, same era.
A robust adversarial training approach to machine reading comprehension
Kai Liu, Xin Liu, An Yang, Jing Liu, Jinsong Su, Sujian Li, and Qiaoqiao She. 2020 · 2020
Cited alongside, same era.
COMET: A neural framework for MT evaluation
Ricardo Rei, Craig Stewart, Ana C. Farinha, and Alon Lavie. 2020 · 2020
Cited alongside, same era.
Adaptive nearest neighbor machine translation
Xin Zheng, Zhirui Zhang, Junliang Guo, Shujian Huang, Boxing Chen, Weihua Luo, and Jiajun Chen. 2021a
Cited in the paper.
Non-parametric unsupervised domain adaptation for neural machine translation
Xin Zheng, Zhirui Zhang, Shujian Huang, Boxing Chen, Jun Xie, Weihua Luo, and Jiajun Chen. 2021b
Cited in the paper.

Then

Boosting neural machine translation with similar translations
Jitao Xu, Josep Maria Crego, and Jean Senellart. 2020 · 2020
Later among the works it cites.
Neural machine translation with monolingual translation memory
Deng Cai, Yan Wang, Huayang Li, Wai Lam, and Lemao Liu. 2021 · 2021
Later among the works it cites.
Fast and accurate neural machine translation with translation memory
Qiuxiang He, Guoping Huang, Qu Cui, Li Li, and Lemao Liu. 2021 · 2021
Later among the works it cites.
Learning kernel-smoothed machine translation with retrieved examples
Qingnan Jiang, Mingxuan Wang, Jun Cao, Shanbo Cheng, Shujian Huang, and Lei Li. 2021 · 2021
Later among the works it cites.
Billion-scale similarity search with gpus
Jeff Johnson, Matthijs Douze, and Hervé Jégou. 2021 · 2021
Later among the works it cites.
Nearest neighbor machine translation
Urvashi Khandelwal, Angela Fan, Dan Jurafsky, Luke Zettlemoyer, and Mike Lewis. 2021 · 2021
Later among the works it cites.
Fast nearest neighbor machine translation
Yuxian Meng, Xiaoya Li, Xiayu Zheng, Fei Wu, Xiaofei Sun, Tianwei Zhang, and Jiwei Li. 2022 · 2022
Closest in time.
Towards robust neural machine translation with iterative scheduled data-switch training
Zhongjian Miao, Xiang Li, Liyan Kang, Wen Zhang, Chulun Zhou, Yidong Chen, Bin Wang, Min Zhang, and Jinsong Su. 2022 · 2022
Closest in time.
Efficient cluster-based k-nearest-neighbor machine translation
Dexin Wang, Kai Fan, Boxing Chen, and Deyi Xiong. 2022 · 2022
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Reading the bibliography…