SesameBERT: Attention for Anywhere

Distributed representations of words and phrases and their compositionality

Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg Corrado, and Jeffrey Dean · 2013

Earlier work this paper cites.

Glove: Global vectors for word representation

Jeffrey Pennington, Richard Socher, and Christopher D. Manning · 2014

Earlier work this paper cites.

Neural machine translation by jointly learning to align and translate

Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio · 2015

Earlier work this paper cites.

Key-value memory networks for directly reading documents

Alexander H. Miller, Adam Fisch, Jesse Dodge, Amir-Hossein Karimi, Antoine Bordes, and Jason Weston · 2016

Earlier work this paper cites.

Attention is all you need

Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin · 2017

Earlier work this paper cites.

Visual concepts and compositional voting

Jianyu Wang, Zhishuai Zhang, Cihang Xie, Yuyin Zhou, Vittal Premachandran, Jun Zhu, Lingxi Xie, and Alan Yuille · 2017

Earlier work this paper cites.

Modeling localness for self-attention networks

Derek F. Wong Fandong Meng Lidia S. Chao Tong Zhang Baosong Yang, Zhaopeng Tu · 2018

Earlier work this paper cites.

Behavior analysis of nli models: Uncovering the influence of three factors on robustness

V. Ivan Sanchez Carmona, Jeff Mitchell, and Sebastian Riedel · 2018

Cited alongside, same era.

Evaluating compositionality in sentence embeddings

Ishita Dasgupta, Demi Guo, Andreas Stuhlmuller, Samuel J. Gershman, and Noah D. Goodman · 2018

Cited alongside, same era.

Squeeze-and-excitation networks

Jie Hu, Li Shen, Samuel Albanie, Gang Sun, and Enhua Wu · 2018

Cited alongside, same era.

Stress test evaluation for natural language inference

Aakanksha Naik, Abhilasha Ravichander, Norman Sadeh, Carolyn Rose, and Graham Neubig · 2018

Cited alongside, same era.

Deep contextualized word representations

Matthew E. Peters, Mark Neumann, Mohit Iyyer, Matt Gardner, Christopher Clark, Kenton Lee, and Luke Zettlemoyer · 2018

Cited alongside, same era.

Improving language understanding by generative pre-training

Alec Radford, Karthik Narasimhan, Tim Salimans, and Ilya Sutskever · 2018

Efficient training of bert by progressively stacking

Linyuan Gong, Di He, Zhuohan Li, Tao Qin, Liwei Wang, and Tieyan Liu · 2019

Closest in time.

Information aggregation for multi-head attention with routing-by-agreement

Jian Li, Baosong Yang, Zi-Yi Dou, Xing Wang, Michael R. Lyu, and Zhaopeng Tu · 2019

Closest in time.

Non-entailed subsequences as a challenge for natural language inference

R. Thomas McCoy and Tal Linzen · 2019

Closest in time.

Right for the wrong reasons: Diagnosing syntactic heuristics in natural language inference

R. Thomas McCoy, Ellie Pavlick, and Tal Linzen · 2019

Closest in time.

Glue: A multi-task benchmark and analysis platform for natural language understanding

Alex Wang, Amanpreet Singh, Julian Michael, Felix Hill, Omer Levy, and Samuel R. Bowman · 2019

Closest in time.

Convolutional self-attention networks

Baosong Yang, Longyue Wang, Derek Wong, Lidia S. Chao, and Zhaopeng Tu · 2019