Fetching the paper…
Reading the bibliography…
Non-autoregressive neural machine translation (NAT) usually employs sequence-level knowledge distillation using autoregressive neural machine translation (AT) as its teacher model.
Bleu: a method for automatic evaluation of machine translation
Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002 · 2002
Earlier work this paper cites.
Mecab : Yet another part-of-speech and morphological analyzer
Taku Kudo. 2005 · 2005
Earlier work this paper cites.
Findings of the 2014 workshop on statistical machine translation
Ondrej Bojar, Christian Buck, Christian Federmann, Barry Haddow, Philipp Koehn, Johannes Leveling, Christof Monz, Pavel Pecina, Matt Post, Herve Saint-Amand, Radu Soricut, Lucia Specia, and Aleš Tamchyna. 2014 · 2014
Earlier work this paper cites.
Distilling the knowledge in a neural network
Geoffrey Hinton, Oriol Vinyals, and Jeffrey Dean. 2015 · 2015
Earlier work this paper cites.
Sequence-level knowledge distillation
Yoon Kim and Alexander M. Rush. 2016 · 2016
Earlier work this paper cites.
Aspec: Asian scientific paper excerpt corpus
Toshiaki Nakazawa, Manabu Yaguchi, Kiyotaka Uchimoto, Masao Utiyama, Eiichiro Sumita, Sadao Kurohashi, and Hitoshi Isahara. 2016 · 2016
Earlier work this paper cites.
BERT: pre-training of deep bidirectional transformers for language understanding
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018 · 2018
Cited alongside, same era.
SentencePiece: A simple and language independent subword tokenizer and detokenizer for neural text processing
Taku Kudo and John Richardson. 2018 · 2018
Cited alongside, same era.
A call for clarity in reporting BLEU scores
Matt Post. 2018 · 2018
Cited alongside, same era.
Mask-predict: Parallel decoding of conditional masked language models
Marjan Ghazvininejad, Omer Levy, Yinhan Liu, and Luke Zettlemoyer. 2019 · 2019
Cited alongside, same era.
Levenshtein transformer
Jiatao Gu, Changhan Wang, and Junbo Zhao. 2019 · 2019
Cited alongside, same era.
Controlling the Output Length of Neural Machine Translation
fairseq: A fast, extensible toolkit for sequence modeling
Myle Ott, Sergey Edunov, Alexei Baevski, Angela Fan, Sam Gross, Nathan Ng, David Grangier, and Michael Auli. 2019 · 2019
Later among the works it cites.
Positional encoding to control output sequence length
Sho Takase and Naoaki Okazaki. 2019 · 2019
Later among the works it cites.
Addressing the under-translation problem from the entropy perspective
Yang Zhao, Jiajun Zhang, Chengqing Zong, Zhongjun He, and Hua Wu. 2019 · 2019
Later among the works it cites.
Incorporating noisy length constraints into transformer with length-aware positional encodings
Yui Oka, Katsuki Chousa, Katsuhito Sudoh, and Satoshi Nakamura. 2020 · 2020
Later among the works it cites.
Understanding knowledge distillation in non-autoregressive machine translation
Chunting Zhou, Jiatao Gu, and Graham Neubig. 2020 · 2020
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Surafel Melaku Lakew, Mattia Di Gangi, and Marcello Federico. 2019 · 2019
Cited alongside, same era.
Length-constrained neural machine translation using length prediction and perturbation into length-aware positional encoding
Yui Oka, Katsuhito Sudoh, and Satoshi Nakamura. 2021 · 2021
Closest in time.