2018

XNMT: The eXtensible Neural Machine Translation Toolkit

Neubig, Graham, Sperber, Matthias, Wang, Xinyi et al.

Understand

This paper describes XNMT, the eXtensible Neural Machine Translation toolkit.

XNMT distin- guishes itself from other open-source NMT toolkits by its focus on modular code design, with the purpose of enabling fast iteration in research and replicable, reliable results.
In this paper we describe the design of XNMT and its experiment configuration system, and demonstrate its utility on the tasks of machine translation, speech recognition, and multi-tasked machine translation/parsing.
XNMT is available open-source at https://github.com/neulab/xnmt

Built on

The design for the wall street journal-based csr corpus
Paul, D. B. and Baker, J. M. (1992) · 1992
Earlier work this paper cites.
Learning deep structured semantic models for web search using clickthrough data
Huang, P.-S., He, X., Gao, J., Deng, L., Acero, A., and Heck, L. (2013) · 2013
Earlier work this paper cites.
Recurrent Continuous Translation Models
Kalchbrenner, N. and Blunsom, P. (2013) · 2013
Earlier work this paper cites.
Adam: A method for stochastic optimization
Original
Kingma, D. P. and Ba, J. (2014) · 2014
Earlier work this paper cites.
Enhancing the ted-lium corpus with selected data for language modeling and more ted talks
Rousseau, A., Deléglise, P., and Estève, Y. (2014) · 2014
Earlier work this paper cites.
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., and Le, Q. V. (2014) · 2014
Earlier work this paper cites.
Neural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., and Bengio, Y. (2015) · 2015
Earlier work this paper cites.
Semi-supervised sequence learning
Dai, A. M. and Le, Q. V. (2015) · 2015
Earlier work this paper cites.

Similar

Effective approaches to attention-based neural machine translation
Original
Luong, M.-T., Pham, H., and Manning, C. D. (2015) · 2015
Cited alongside, same era.
Sequence level training with recurrent neural networks
Original
Ranzato, M., Chopra, S., Auli, M., and Zaremba, W. (2015) · 2015
Cited alongside, same era.
Grammar as a foreign language
Vinyals, O., Kaiser, L., Koo, T., Petrov, S., Sutskever, I., and Hinton, G. E. (2015) · 2015
Cited alongside, same era.
Character-level convolutional networks for text classification
Zhang, X., Zhao, J., and LeCun, Y. (2015) · 2015
Cited alongside, same era.
Listen, attend and spell: A neural network for large vocabulary conversational speech recognition
Chan, W., Jaitly, N., Le, Q., and Vinyals, O. (2016) · 2016
Cited alongside, same era.
Systran’s pure neural machine translation systems
Original
Crego, J., Kim, J., Klein, G., Rebollo, A., Yang, K., Senellart, J., Akhanov, E., Brunelle, P., Coquard, A., Deng, Y., et al. (2016) · 2016
Cited alongside, same era.
A theoretically grounded application of dropout in recurrent neural networks
Gal, Y. and Ghahramani, Z. (2016) · 2016
Cited alongside, same era.
Unsupervised learning of spoken language with visual context
Harwath, D., Torralba, A., and Glass, J. (2016) · 2016
Cited alongside, same era.

Then

Using the output embedding to improve language models
Original
Press, O. and Wolf, L. (2016) · 2016
Later among the works it cites.
Neural machine translation of rare words with subword units
Sennrich, R., Haddow, B., and Birch, A. (2016) · 2016
Later among the works it cites.
Minimum risk training for neural machine translation
Shen, S., Cheng, Y., He, Z., He, W., Wu, H., Sun, M., and Liu, Y. (2016) · 2016
Later among the works it cites.
Rethinking the inception architecture for computer vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., and Wojna, Z. (2016) · 2016
Later among the works it cites.
DyNet: The Dynamic Neural Network Toolkit
Original
Neubig, G., Dyer, C., Goldberg, Y., Matthews, A., Ammar, W., Anastasopoulos, A., Ballesteros, M., Chiang, D., Clothiaux, D., Cohn, T., Duh, K., Faruqui, M., Gan, C., Garrette, D., Ji, Y., Kong, L., Kuncoro, A., Kumar, G., Malaviya, C., Michel, P., Oda, Y., Richardson, M., Saphra, N., Swayamdipta, S., and Yin, P. (2017) · 2017
Later among the works it cites.
Attention is all you need
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, Ł., and Polosukhin, I. (2017) · 2017
Later among the works it cites.
Very deep convolutional networks for end-to-end speech recognition
Zhang, Y., Chan, W., and Jaitly, N. (2017) · 2017
Later among the works it cites.
Linguistic unit discovery from multi-modal inputs in unwritten languages: Summary of the ”speaking rosetta” JSALT 2017 workshop
Scharenborg, O., Besacier, L., Black, A., Hasegawa-Johnson, M., Metze, F., Neubig, G., Stuker, S., Godard, P., Muller, M., Ondel, L., Palaskar, S., Arthur, P., Ciannella, F., Du, M., Larsen, E., Merkx, D., Riad, R., Wang, L., and Dupoux, E. (2018) · 2018
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Reading the bibliography…