Fetching the paper…
Reading the bibliography…
We present a simple and effective pretraining strategy {D}en{o}ising {T}raining DoT for neural machine translation.
Negative evidence in language acquisition
Gary F Marcus. 1993 · 1993
Earlier work this paper cites.
Catastrophic forgetting in connectionist networks
Robert M French. 1999 · 1999
Earlier work this paper cites.
Bleu: a method for automatic evaluation of machine translation
Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002 · 2002
Earlier work this paper cites.
Clause restructuring for statistical machine translation
Michael Collins, Philipp Koehn, and Ivona Kučerová. 2005 · 2005
Earlier work this paper cites.
Adam: A method for stochastic optimization
Diederik P. Kingma and Jimmy Ba. 2015 · 2015
Earlier work this paper cites.
Sequence-level knowledge distillation
Yoon Kim and Alexander M. Rush. 2016 · 2016
Earlier work this paper cites.
Neural machine translation of rare words with subword units
Rico Sennrich, Barry Haddow, and Alexandra Birch. 2016 · 2016
Earlier work this paper cites.
Attention is all you need
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Lukasz Kaiser, and Illia Polosukhin. 2017 · 2017
Earlier work this paper cites.
Understanding back-translation at scale
Sergey Edunov, Myle Ott, Michael Auli, and David Grangier. 2018 · 2018
Earlier work this paper cites.
Non-autoregressive neural machine translation
Jiatao Gu, James Bradbury, Caiming Xiong, Victor OK Li, and Richard Socher. 2018 · 2018
Earlier work this paper cites.
Achieving human parity on automatic chinese to english news translation
Hany Hassan, Anthony Aue, Chang Chen, Vishal Chowdhary, Jonathan Clark, Christian Federmann, Xuedong Huang, Marcin Junczys-Dowmunt, William Lewis, Mu Li, et al. 2018 · 2018
Earlier work this paper cites.
SentencePiece: A simple and language independent subword tokenizer and detokenizer for neural text processing
Taku Kudo and John Richardson. 2018 · 2018
Cited alongside, same era.
A call for clarity in reporting BLEU scores
Matt Post. 2018 · 2018
Cited alongside, same era.
Prompsit’s submission to WMT 2018 parallel corpus filtering shared task
Víctor M. Sánchez-Cartagena, Marta Bañón, Sergio Ortiz-Rojas, and Gema Ramírez. 2018 · 2018
Cited alongside, same era.
An empirical exploration of curriculum learning for neural machine translation
Xuan Zhang, Gaurav Kumar, Huda Khayrallah, Kenton Murray, Jeremy Gwinnup, Marianna J Martindale, Paul McNamee, Kevin Duh, and Marine Carpuat. 2018 · 2018
Cited alongside, same era.
Findings of the 2019 conference on machine translation (wmt19)
Loïc Barrault, Ondřej Bojar, Marta R Costa-Jussa, Christian Federmann, Mark Fishel, Yvette Graham, Barry Haddow, Matthias Huck, Philipp Koehn, Shervin Malmasi, et al. 2019 · 2019
Cited alongside, same era.
Bart: Denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension
Mike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad, Abdelrahman Mohamed, Omer Levy, Veselin Stoyanov, and Luke Zettlemoyer. 2020 · 2020
Later among the works it cites.
Data diversification: A simple strategy for neural machine translation
Xuan-Phi Nguyen, Shafiq Joty, Wu Kui, and Ai Ti Aw. 2020 · 2020
Later among the works it cites.
Csp: Code-switching pre-training for neural machine translation
Zhen Yang, Bojie Hu, Ambyera Han, Shen Huang, and Qi Ju. 2020 · 2020
Later among the works it cites.
Findings of the 2021 conference on machine translation (wmt21)
Farhad Akhbardeh, Arkady Arkhangorodsky, Magdalena Biesialska, Ondřej Bojar, Rajen Chatterjee, et al. 2021 · 2021
Later among the works it cites.
Understanding and improving sequence-to-sequence pretraining for neural machine translation
ARR Nov. Anonymous. 2021 · 2021
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Competence-based curriculum learning for neural machine translation
Emmanouil Antonios Platanios, Otilia Stretcu, Graham Neubig, Barnabás Poczós, and Tom Mitchell. 2019 · 2019
Cited alongside, same era.
Mass: Masked sequence to sequence pre-training for language generation
Kaitao Song, Xu Tan, Tao Qin, Jianfeng Lu, and Tie-Yan Liu. 2019 · 2019
Cited alongside, same era.
Multilingual neural machine translation with knowledge distillation
Xu Tan, Yi Ren, Di He, Tao Qin, Zhou Zhao, and Tie-Yan Liu. 2019 · 2019
Cited alongside, same era.
Pay less attention with lightweight and dynamic convolutions
Felix Wu, Angela Fan, Alexei Baevski, Yann N Dauphin, and Michael Auli. 2019 · 2019
Cited alongside, same era.
Proceedings of the fifth conference on machine translation
Loïc Barrault, Ondřej Bojar, Fethi Bougares, Rajen Chatterjee, Marta R Costa-jussà, Christian Federmann, Mark Fishel, Alexander Fraser, Yvette Graham, Paco Guzman, et al. 2020 · 2020
Cited alongside, same era.
Don’t stop pretraining: Adapt language models to domains and tasks
Suchin Gururangan, Ana Marasović, Swabha Swayamdipta, Kyle Lo, Iz Beltagy, Doug Downey, and Noah A. Smith. 2020 · 2020
Cited alongside, same era.
Tagged back-translation
Isaac Caswell, Ciprian Chelba, and David Grangier. 2019a
Cited in the paper.
Self-supervised and supervised joint training for resource-rich machine translation–supplementary materials
Yong Cheng, Wei Wang, Lu Jiang, and Wolfgang Macherey. 2021 · 2021
Later among the works it cites.
Learning language specific sub-network for multilingual machine translation
Zehui Lin, Liwei Wu, Mingxuan Wang, and Lei Li. 2021 · 2021
Later among the works it cites.
Do transformer modifications transfer across implementations and applications?
Sharan Narang, Hyung Won Chung, Yi Tay, Liam Fedus, Thibault Fevry, Michael Matena, Karishma Malkan, Noah Fiedel, Noam Shazeer, Zhenzhong Lan, Yanqi Zhou, Wei Li, Nan Ding, Jake Marcus, Adam Roberts, and Colin Raffel. 2021 · 2021
Later among the works it cites.
A chat with andrew on mlops: From model-centric to data-centric ai
Andrew Ng. 2021 · 2021
Later among the works it cites.
Language modeling, lexical translation, reordering: The training process of NMT through the lens of classical SMT
Elena Voita, Rico Sennrich, and Ivan Titov. 2021 · 2021
Later among the works it cites.
Self-guided curriculum learning for neural machine translation
Lei Zhou, Liang Ding, Kevin Duh, Shinji Watanabe, Ryohei Sasano, and Koichi Takeda. 2021 · 2021
Later among the works it cites.