Fetching the paper…
Reading the bibliography…
We introduce multi-modal, attention-based neural machine translation (NMT) models which incorporate visual features into different parts of both the encoder and the decoder.
Improved backing-off for m-gram language modeling
Reinhard Kneser and Hermann Ney. 1995 · 1995
Earlier work this paper cites.
Long Short-Term Memory
Sepp Hochreiter and Jürgen Schmidhuber. 1997 · 1997
Earlier work this paper cites.
BLEU: A Method for Automatic Evaluation of Machine Translation
Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002 · 2002
Earlier work this paper cites.
A Neural Probabilistic Language Model
Yoshua Bengio, Réjean Ducharme, Pascal Vincent, and Christian Janvin. 2003 · 2003
Earlier work this paper cites.
Minimum Error Rate Training in Statistical Machine Translation
Franz Josef Och. 2003 · 2003
Earlier work this paper cites.
A study of translation edit rate with targeted human annotation
Matthew Snover, Bonnie Dorr, Richard Schwartz, Linnea Micciulla, and John Makhoul. 2006 · 2006
Earlier work this paper cites.
Moses: Open Source Toolkit for Statistical Machine Translation
Philipp Koehn, Hieu Hoang, Alexandra Birch, Chris Callison-Burch, Marcello Federico, Nicola Bertoldi, Brooke Cowan, Wade Shen, Christine Moran, Richard Zens, Chris Dyer, Ondřej Bojar, Alexandra Constantin, and Evan Herbst. 2007 · 2007
Earlier work this paper cites.
Better Hypothesis Testing for Statistical Machine Translation: Controlling for Optimizer Instability
Jonathan H. Clark, Chris Dyer, Alon Lavie, and Noah A. Smith. 2011 · 2011
Earlier work this paper cites.
Images as context in Statistical Machine Translation
Iacer Calixto, Teofilo de Campos, and Lucia Specia. 2012 · 2012
Earlier work this paper cites.
ADADELTA: An Adaptive Learning Rate Method
Matthew D. Zeiler. 2012 · 2012
Earlier work this paper cites.
Generating Sequences With Recurrent Neural Networks
Alex Graves. 2013 · 2013
Earlier work this paper cites.
Framing Image Description As a Ranking Task: Data, Models and Evaluation Metrics
Micah Hodosh, Peter Young, and Julia Hockenmaier. 2013 · 2013
Earlier work this paper cites.
Recurrent Continuous Translation Models
Nal Kalchbrenner and Phil Blunsom. 2013 · 2013
Earlier work this paper cites.
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Kyunghyun Cho, Bart van Merrienboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. 2014b · 2014
Earlier work this paper cites.
Meteor Universal: Language Specific Translation Evaluation for Any Target Language
Michael Denkowski and Alon Lavie. 2014 · 2014
Earlier work this paper cites.
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Ross Girshick, Jeff Donahue, Trevor Darrell, and Jitendra Malik. 2014 · 2014
Earlier work this paper cites.
Unifying visual-semantic embeddings with multimodal neural language models
Ryan Kiros, Ruslan Salakhutdinov, and Richard S. Zemel. 2014 · 2014
Cited alongside, same era.
Explain Images with Multimodal Recurrent Neural Networks
Junhua Mao, Wei Xu, Yi Yang, Jiang Wang, and Alan L. Yuille. 2014 · 2014
Cited alongside, same era.
Very Deep Convolutional Networks for Large-Scale Image Recognition
K. Simonyan and A. Zisserman. 2014 · 2014
Cited alongside, same era.
Sequence to Sequence Learning with Neural Networks
Ilya Sutskever, Oriol Vinyals, and Quoc V Le. 2014 · 2014
Cited alongside, same era.
From image descriptions to visual denotations: New similarity metrics for semantic inference over event descriptions
Peter Young, Alice Lai, Micah Hodosh, and Julia Hockenmaier. 2014 · 2014
Show and tell: A neural image caption generator
Oriol Vinyals, Alexander Toshev, Samy Bengio, and Dumitru Erhan. 2015 · 2015
Later among the works it cites.
Does Multimodality Help Human and Machine for Translation and Image Captioning?
Ozan Caglayan, Walid Aransa, Yaxing Wang, Marc Masana, Mercedes García-Martínez, Fethi Bougares, Loïc Barrault, and Joost van de Weijer. 2016 · 2016
Later among the works it cites.
DCU-UvA Multimodal MT System Report
Iacer Calixto, Desmond Elliott, and Stella Frank. 2016 · 2016
Later among the works it cites.
Multi30K: Multilingual English-German Image Descriptions
Desmond Elliott, Stella Frank, Khalil Sima’an, and Lucia Specia. 2016 · 2016
Later among the works it cites.
Multi-Way, Multilingual Neural Machine Translation with a Shared Attention Mechanism
Orhan Firat, Kyunghyun Cho, and Yoshua Bengio. 2016 · 2016
Later among the works it cites.
A Theoretically Grounded Application of Dropout in Recurrent Neural Networks
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
Neural Machine Translation by Jointly Learning to Align and Translate
Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2015 · 2015
Cited alongside, same era.
Scheduled Sampling for Sequence Prediction with Recurrent Neural Networks
Samy Bengio, Oriol Vinyals, Navdeep Jaitly, and Noam M. Shazeer. 2015 · 2015
Cited alongside, same era.
Long-term Recurrent Convolutional Networks for Visual Recognition and Description
Jeff Donahue, Lisa Anne Hendricks, Sergio Guadarrama, Marcus Rohrbach, Subhashini Venugopalan, Trevor Darrell, and Kate Saenko. 2015 · 2015
Cited alongside, same era.
Multi-Task Learning for Multiple Language Translation
Daxiang Dong, Hua Wu, Wei He, Dianhai Yu, and Haifeng Wang. 2015 · 2015
Cited alongside, same era.
Multi-language image description with neural sequence models
Desmond Elliott, Stella Frank, and Eva Hasler. 2015 · 2015
Cited alongside, same era.
Deep visual-semantic alignments for generating image descriptions
Andrej Karpathy and Li Fei-Fei. 2015 · 2015
Cited alongside, same era.
Effective Approaches to Attention-based Neural Machine Translation
Thang Luong, Hieu Pham, and Christopher D. Manning. 2015 · 2015
Cited alongside, same era.
Yarin Gal and Zoubin Ghahramani. 2016 · 2016
Later among the works it cites.
Multimodal Pivots for Image Caption Translation
Julian Hitschler, Shigehiko Schamoni, and Stefan Riezler. 2016 · 2016
Later among the works it cites.
Attention-based Multimodal Neural Machine Translation
Po-Yao Huang, Frederick Liu, Sz-Rung Shiang, Jean Oh, and Chris Dyer. 2016 · 2016
Later among the works it cites.
CUNI System for WMT16 Automatic Post-Editing and Multimodal Translation Tasks
Jindřich Libovický, Jindřich Helcl, Marek Tlustý, Ondřej Bojar, and Pavel Pecina. 2016 · 2016
Later among the works it cites.
Multi-Task Sequence to Sequence Learning
Minh-Thang Luong, Quoc V. Le, Ilya Sutskever, Oriol Vinyals, and Lukasz Kaiser. 2016 · 2016
Later among the works it cites.
SHEF-Multimodal: Grounding Machine Translation on Images
Kashif Shah, Josiah Wang, and Lucia Specia. 2016 · 2016
Later among the works it cites.
A Shared Task on Multimodal Machine Translation and Crosslingual Image Description
Lucia Specia, Stella Frank, Khalil Sima’an, and Desmond Elliott. 2016 · 2016
Later among the works it cites.
Modeling Coverage for Neural Machine Translation
Zhaopeng Tu, Zhengdong Lu, Yang Liu, Xiaohua Liu, and Hang Li. 2016 · 2016
Later among the works it cites.
Stereotyping and bias in the flickr30k dataset
Emiel van Miltenburg. 2015 · 2016
Later among the works it cites.
Show, attend and tell: Neural image caption generation with visual attention
Kelvin Xu, Jimmy Ba, Ryan Kiros, Kyunghyun Cho, Aaron Courville, Ruslan Salakhudinov, Rich Zemel, and Yoshua Bengio. 2015 · 2057
Closest in time.