DA-Transformer: Distance-aware Transformer

Tener: Adapting transformer encoder for name entity recognition

Original

Hang Yan, Bocao Deng, Xiaonan Li, and Xipeng Qiu. 2019 · 1911

Earlier work this paper cites.

Improving attention mechanism with query-value interaction

Original

Chuhan Wu, Fangzhao Wu, Tao Qi, and Yongfeng Huang. 2020a · 2010

Earlier work this paper cites.

Deep sparse rectifier neural networks

Xavier Glorot, Antoine Bordes, and Yoshua Bengio. 2011 · 2011

Earlier work this paper cites.

Recursive deep models for semantic compositionality over a sentiment treebank

Richard Socher, Alex Perelygin, Jean Wu, Jason Chuang, Christopher D Manning, Andrew Y Ng, and Christopher Potts. 2013 · 2013

Earlier work this paper cites.

Glove: Global vectors for word representation

Jeffrey Pennington, Richard Socher, and Christopher Manning. 2014 · 2014

Earlier work this paper cites.

A large annotated corpus for learning natural language inference

Samuel Bowman, Gabor Angeli, Christopher Potts, and Christopher D Manning. 2015 · 2015

Earlier work this paper cites.

Adam: A method for stochastic optimization

Diederik P. Kingma and Jimmy Ba. 2015 · 2015

Earlier work this paper cites.

Layer normalization

Original

Jimmy Lei Ba, Jamie Ryan Kiros, and Geoffrey E Hinton. 2016 · 2016

Earlier work this paper cites.

Deep residual learning for image recognition

Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016 · 2016

Cited alongside, same era.

Ups and downs: Modeling the visual evolution of fashion trends with one-class collaborative filtering

Ruining He and Julian McAuley. 2016 · 2016

Cited alongside, same era.

Attention is all you need

Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017 · 2017

Cited alongside, same era.

Self-attention with relative position representations

Peter Shaw, Jakob Uszkoreit, and Ashish Vaswani. 2018 · 2018

Cited alongside, same era.

Transformer-xl: Attentive language models beyond a fixed-length context

Zihang Dai, Zhilin Yang, Yiming Yang, Jaime G Carbonell, Quoc Le, and Ruslan Salakhutdinov. 2019 · 2019

Cited alongside, same era.

Bert: Pre-training of deep bidirectional transformers for language understanding

Text generation from knowledge graphs with graph transformers

Rik Koncel-Kedziorski, Dhanush Bekal, Yi Luan, Mirella Lapata, and Hannaneh Hajishirzi. 2019 · 2019

Later among the works it cites.

Language models are unsupervised multitask learners

Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. 2019 · 2019

Later among the works it cites.

Self-attention with structural position representations

Xing Wang, Zhaopeng Tu, Longyue Wang, and Shuming Shi. 2019 · 2019

Later among the works it cites.

Neural news recommendation with multi-head self-attention

Chuhan Wu, Fangzhao Wu, Suyu Ge, Tao Qi, Yongfeng Huang, and Xing Xie. 2019 · 2019

Later among the works it cites.

Bert post-training for review reading comprehension and aspect-based sentiment analysis

Hu Xu, Bing Liu, Lei Shu, and S Yu Philip. 2019 · 2019

Later among the works it cites.

Context-aware self-attention networks

Baosong Yang, Jian Li, Derek F Wong, Lidia S Chao, Xing Wang, and Zhaopeng Tu. 2019 · 2019