Fetching the paper…
Reading the bibliography…
The Transformer architecture is widely used in natural language processing.
On the construction and comparison of difference schemes
G. Strang · 1968
Earlier work this paper cites.
Comparison of the predicted and observed secondary structure of t4 phage lysozyme
B. W. Matthews · 1975
Earlier work this paper cites.
Computer methods for ordinary differential equations and differential-algebraic equations
U. M. Ascher and L. R. Petzold · 1998
Earlier work this paper cites.
The error of the splitting scheme for solving evolutionary equations
A. V. Bobylev and T. Ohwada · 2001
Earlier work this paper cites.
Splitting methods
R. I. McLachlan and G. R. W. Quispel · 2002
Earlier work this paper cites.
Bleu: a method for automatic evaluation of machine translation
K. Papineni, S. Roukos, T. Ward, and W.-J. Zhu · 2002
Earlier work this paper cites.
Automatically constructing a corpus of sentential paraphrases
W. B. Dolan and C. Brockett · 2005
Earlier work this paper cites.
Ordinary differential equations by vladimir i. arnold
C. Chicone · 2007
Earlier work this paper cites.
Moses: Open source toolkit for statistical machine translation
P. Koehn, H. Hoang, A. Birch, C. Callison-Burch, M. Federico, N. Bertoldi, B. Cowan, W. Shen, C. Moran, R. Zens, C. Dyer, O. Bojar, A. Constantin, and E. Herbst · 2007
Earlier work this paper cites.
The fifth PASCAL recognizing textual entailment challenge
L. Bentivogli, I. Dagan, H. T. Dang, D. Giampiccolo, and B. Magnini · 2009
Earlier work this paper cites.
Decomposition methods for differential equations: theory and applications
J. Geiser · 2009
Earlier work this paper cites.
The Winograd schema challenge
H. J. Levesque, E. Davis, and L. Morgenstern · 2011
Earlier work this paper cites.
An introduction to celestial mechanics
F. R. Moulton · 2012
Earlier work this paper cites.
Recursive deep models for semantic compositionality over a sentiment treebank
R. Socher, A. Perelygin, J. Wu, J. Chuang, C. D. Manning, A. Ng, and C. Potts · 2013
Earlier work this paper cites.
Y. Zhu, R. Kiros, R. Zemel, R. Salakhutdinov, R. Urtasun, A. Torralba, and S. Fidler · 2015
Earlier work this paper cites.
Identity mappings in deep residual networks
K. He, X. Zhang, S. Ren, and J. Sun · 2016
Earlier work this paper cites.
J. Lei Ba, J. R. Kiros, and G. E. Hinton · 2016
Earlier work this paper cites.
Bridging the gaps between residual learning, recurrent neural networks and visual cortex
Q. Liao and T. Poggio · 2016
Earlier work this paper cites.
SQuAD: 100,000+ questions for machine comprehension of text
P. Rajpurkar, J. Zhang, K. Lopyrev, and P. Liang · 2016
Cited alongside, same era.
Neural machine translation of rare words with subword units
R. Sennrich, B. Haddow, and A. Birch · 2016
Cited alongside, same era.
Rethinking the inception architecture for computer vision
C. Szegedy, V. Vanhoucke, S. Ioffe, J. Shlens, and Z. Wojna · 2016
Cited alongside, same era.
Weighted transformer network for machine translation
K. Ahmed, N. S. Keskar, and R. Socher · 2017
Cited alongside, same era.
Semeval-2017 task 1: Semantic textual similarity-multilingual and cross-lingual focused evaluation
D. Cer, M. Diab, E. Agirre, I. Lopez-Gazpio, and L. Specia · 2017
Cited alongside, same era.
Scaling neural machine translation
M. Ott, S. Edunov, D. Grangier, and M. Auli · 2018
Later among the works it cites.
Deep contextualized word representations
M. E. Peters, M. Neumann, M. Iyyer, M. Gardner, C. Clark, K. Lee, and L. Zettlemoyer · 2018
Later among the works it cites.
Self-attention with relative position representations
P. Shaw, J. Uszkoreit, and A. Vaswani · 2018
Later among the works it cites.
Nonlocal neural networks, nonlocal diffusion and nonlocal modeling
Y. Tao, Q. Sun, Q. Du, and W. Liu · 2018
Later among the works it cites.
Deep limits of residual neural networks
M. Thorpe and Y. van Gennip · 2018
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Convolutional Sequence to Sequence Learning
J. Gehring, M. Auli, D. Grangier, D. Yarats, and Y. N. Dauphin · 2017
Cited alongside, same era.
Splitting methods in communication, imaging, science, and engineering
R. Glowinski, S. J. Osher, and W. Yin · 2017
Cited alongside, same era.
Stable architectures for deep neural networks
E. Haber and L. Ruthotto · 2017
Cited alongside, same era.
Y. Lu, A. Zhong, Q. Li, and B. Dong · 2017
Cited alongside, same era.
Attention is all you need
A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser, and I. Polosukhin · 2017
Cited alongside, same era.
A proposal on machine learning via dynamical systems
E. Weinan · 2017
Cited alongside, same era.
Character-level language modeling with deeper self-attention
R. Al-Rfou, D. Choe, N. Constant, M. Guo, and L. Jones · 2018
Cited alongside, same era.
Later among the works it cites.
Neural network acceptability judgments
A. Warstadt, A. Singh, and S. R. Bowman · 2018
Later among the works it cites.
A broad-coverage challenge corpus for sentence understanding through inference
A. Williams, N. Nangia, and S. R. Bowman · 2018
Later among the works it cites.
Convolutional neural networks combined with runge-kutta methods
M. Zhu, B. Chang, and C. Fu · 2018
Later among the works it cites.
Antisymmetricrnn: A dynamical system view on recurrent neural networks
B. Chang, M. Chen, E. Haber, and E. H. Chi · 2019
Closest in time.
Transformer-xl: Attentive language models beyond a fixed-length context
Z. Dai, Z. Yang, Y. Yang, W. W. Cohen, J. Carbonell, Q. V. Le, and R. Salakhutdinov · 2019
Closest in time.
Language models are unsupervised multitask learners
A. Radford, J. Wu, R. Child, D. Luan, D. Amodei, and I. Sutskever · 2019
Closest in time.
Transport analysis of infinitely deep neural network
S. Sonoda and N. Murata · 2019
Closest in time.
GLUE: A multi-task benchmark and analysis platform for natural language understanding
A. Wang, A. Singh, J. Michael, F. Hill, O. Levy, and S. R. Bowman · 2019
Closest in time.
Pay less attention with lightweight and dynamic convolutions
F. Wu, A. Fan, A. Baevski, Y. N. Dauphin, and M. Auli · 2019
Closest in time.
Fixup initialization: Residual learning without normalization
H. Zhang, Y. N. Dauphin, and T. Ma · 2019
Closest in time.
The bonfire of time
W. Zhang · 2019
Closest in time.
Dynamically unfolding recurrent restorer: A moving endpoint control method for image restoration
X. Zhang, Y. Lu, J. Liu, and B. Dong · 2019
Closest in time.