Building a Multi-domain Neural Machine Translation Model using Knowledge Distillation

Sepp Hochreiter and Jürgen Schmidhuber, ‘Long short-term memory’, Neural computation

1997

Earlier work this paper cites.

Kyunghyun Cho, Bart van Merriënboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio, ‘Learning phrase representations using RNN encoder–decoder for statistical machine translation’, in Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP)

2014

Earlier work this paper cites.

Ilya Sutskever, Oriol Vinyals, and Quoc V. Le, ‘Sequence to sequence learning with neural networks’, CoRR

Original

2014

Earlier work this paper cites.

Neural machine translation by jointly learning to align and translate, 2014

Original

Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio · 2015

Earlier work this paper cites.

Geoffrey Hinton, Oriol Vinyals, and Jeffrey Dean, ‘Distilling the knowledge in a neural network’, in NIPS Deep Learning and Representation Learning Workshop

2015

Earlier work this paper cites.

Minh-Thang Luong, Hieu Pham, and Christopher D. Manning, ‘Effective approaches to attention-based neural machine translation’, CoRR

Original

2015

Earlier work this paper cites.

Thang Luong, Hieu Pham, and Christopher D. Manning, ‘Effective approaches to attention-based neural machine translation’, in Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing

2015

Earlier work this paper cites.

Markus Freitag and Yaser Al-Onaizan, ‘Fast domain adaptation for neural machine translation’, CoRR

Original

2016

Earlier work this paper cites.

Yoon Kim and Alexander M. Rush, ‘Sequence-level knowledge distillation’, in Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing

2016

Earlier work this paper cites.

Alex M Lamb, Anirudh Goyal ALIAS PARTH GOYAL, Ying Zhang, Saizheng Zhang, Aaron C Courville, and Yoshua Bengio, ‘Professor forcing: A new algorithm for training recurrent networks’, in Advances in Neural Information Processing Systems 29

2016

Earlier work this paper cites.

Christophe Servan, Josep Maria Crego, and Jean Senellart, ‘Domain specialization: a post-training domain adaptation for neural machine translation’, CoRR

Original

2016

Cited alongside, same era.

Praveen Dakwale and Christof Monz, ‘Fine-tuning for neural machine translation with limited degradation across in-and out-of-domain data’, Proceedings of the XVI Machine Translation Summit

2017

Cited alongside, same era.

Markus Freitag, Yaser Al-Onaizan, and Baskaran Sankaran, ‘Ensemble distillation for neural machine translation’, CoRR

Original

2017

Cited alongside, same era.

Guillaume Klein, Yoon Kim, Yuntian Deng, Jean Senellart, and Alexander M. Rush, ‘Opennmt: Open-source toolkit for neural machine translation’, CoRR

Original

2017

Cited alongside, same era.

Sebastian Ruder, Parsa Ghaffari, and John G. Breslin, ‘Knowledge adaptation: Teaching to adapt’, CoRR

Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova, ‘BERT: pre-training of deep bidirectional transformers for language understanding’, CoRR

Original

2018

Later among the works it cites.

Sergey Edunov, Myle Ott, Michael Auli, and David Grangier, ‘Understanding back-translation at scale’, CoRR

Original

2018

Later among the works it cites.

Jeremy Howard and Sebastian Ruder, ‘Fine-tuned language models for text classification’, CoRR

Original

2018

Later among the works it cites.

Matt Post, ‘A call for clarity in reporting BLEU scores’, in Proceedings of the Third Conference on Machine Translation: Research Papers

2018

Later among the works it cites.

Sander Tars and Mark Fishel, ‘Multi-domain neural machine translation’, CoRR