Self-Attention with Relative Position Representations

Neural machine translation by jointly learning to align and translate

Original

Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2014 · 2014

Earlier work this paper cites.

Learning phrase representations using rnn encoder-decoder for statistical machine translation

Original

Kyunghyun Cho, Bart Van Merriënboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. 2014 · 2014

Earlier work this paper cites.

Adam: A method for stochastic optimization

Original

Diederik Kingma and Jimmy Ba. 2014 · 2014

Earlier work this paper cites.

Sequence to sequence learning with neural networks

Ilya Sutskever, Oriol Vinyals, and Quoc V Le. 2014 · 2014

Earlier work this paper cites.

Effective approaches to attention-based neural machine translation

Original

Minh-Thang Luong, Hieu Pham, and Christopher D Manning. 2015 · 2015

Earlier work this paper cites.

End-to-end memory networks

Sainbayar Sukhbaatar, Jason Weston, Rob Fergus, et al. 2015 · 2015

Cited alongside, same era.

Layer normalization

Original

Jimmy Lei Ba, Jamie Ryan Kiros, and Geoffrey E Hinton. 2016 · 2016

Cited alongside, same era.

Neural machine translation in linear time

Original

Nal Kalchbrenner, Lasse Espeholt, Karen Simonyan, Aaron van den Oord, Alex Graves, and Koray Kavukcuoglu. 2016 · 2016

Cited alongside, same era.

A decomposable attention model for natural language inference

Ankur P Parikh, Oscar Täckström, Dipanjan Das, and Jakob Uszkoreit. 2016 · 2016

Cited alongside, same era.

Rethinking the inception architecture for computer vision

Christian Szegedy, Vincent Vanhoucke, Sergey Ioffe, Jon Shlens, and Zbigniew Wojna. 2016 · 2016

Cited alongside, same era.

Google’s neural machine translation system: Bridging the gap between human and machine translation

Original

Yonghui Wu, Mike Schuster, Zhifeng Chen, Quoc V Le, Mohammad Norouzi, Wolfgang Macherey, Maxim Krikun, Yuan Cao, Qin Gao, Klaus Macherey, et al. 2016 · 2016

Later among the works it cites.

Convolutional sequence to sequence learning

Original

Jonas Gehring, Michael Auli, David Grangier, Denis Yarats, and Yann N Dauphin. 2017 · 2017

Later among the works it cites.

Attention is all you need

Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017 · 2017

Later among the works it cites.

Graph attention networks

Original

Petar Veličković, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Liò, and Yoshua Bengio. 2017 · 2017

Later among the works it cites.