2021

An Improved Baseline for Sentence-level Relation Extraction

Zhou, Wenxuan, Chen, Muhao

Understand

Sentence-level relation extraction (RE) aims at identifying the relationship between two entities in a sentence.

Many efforts have been devoted to this problem, while the best performing methods are still far from perfect.
In this paper, we revisit two problems that affect the performance of existing RE models, namely entity representation and noisy or ill-defined labels.
Our improved RE baseline, incorporated with entity representations with typed markers, achieves an F1 of 74.6% on TACRED, significantly outperforms previous SOTA methods.

Built on

Roberta: A robustly optimized bert pretraining approach
Original
Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019 · 1907
Earlier work this paper cites.
Long short-term memory
S. Hochreiter and J. Schmidhuber. 1997 · 1997
Earlier work this paper cites.
K-adapter: Infusing knowledge into pre-trained models with adapters
Original
Ruize Wang, Duyu Tang, Nan Duan, Zhongyu Wei, Xuanjing Huang, Cuihong Cao, Daxin Jiang, Ming Zhou, et al. 2020 · 2002
Earlier work this paper cites.
Neural machine translation by jointly learning to align and translate
Original
Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2015 · 2015
Earlier work this paper cites.
Adam: A method for stochastic optimization
Diederik P. Kingma and Jimmy Ba. 2015 · 2015
Earlier work this paper cites.
Accurate, large minibatch sgd: Training imagenet in 1 hour
Original
Priya Goyal, P. Dollár, Ross B. Girshick, P. Noordhuis, L. Wesolowski, Aapo Kyrola, Andrew Tulloch, Y. Jia, and Kaiming He. 2017 · 2017
Earlier work this paper cites.
Semi-supervised classification with graph convolutional networks
Original
Thomas Kipf and M. Welling. 2017 · 2017
Earlier work this paper cites.
Attention is all you need
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017 · 2017
Earlier work this paper cites.
Position-aware attention and supervised data improve slot filling
Yuhao Zhang, Victor Zhong, Danqi Chen, Gabor Angeli, and Christopher D. Manning. 2017 · 2017
Earlier work this paper cites.
Graph convolution over pruned dependency trees improves relation extraction
Yuhao Zhang, Peng Qi, and Christopher D. Manning. 2018 · 2018
Earlier work this paper cites.

Similar

Matching the blanks: Distributional similarity for relation learning
Livio Baldini Soares, Nicholas FitzGerald, Jeffrey Ling, and Tom Kwiatkowski. 2019 · 2019
Cited alongside, same era.
BERT: Pre-training of deep bidirectional transformers for language understanding
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019 · 2019
Cited alongside, same era.
Knowledge enhanced contextual word representations
Matthew E. Peters, Mark Neumann, Robert Logan, Roy Schwartz, Vidur Joshi, Sameer Singh, and Noah A. Smith. 2019 · 2019
Cited alongside, same era.
ERNIE: Enhanced language representation with informative entities
Zhengyan Zhang, Xu Han, Zhiyuan Liu, Xin Jiang, Maosong Sun, and Qun Liu. 2019 · 2019
Cited alongside, same era.
TACRED revisited: A thorough evaluation of the TACRED relation extraction task
Christoph Alt, Aleksandra Gabryszak, and Leonhard Hennig. 2020 · 2020
Cited alongside, same era.
SpanBERT: Improving pre-training by representing and predicting spans
Mandar Joshi, Danqi Chen, Yinhan Liu, Daniel S. Weld, Luke Zettlemoyer, and Omer Levy. 2020 · 2020
Cited alongside, same era.
Learning from Context or Names? An Empirical Study on Neural Relation Extraction
Hao Peng, Tianyu Gao, Xu Han, Yankai Lin, Peng Li, Zhiyuan Liu, Maosong Sun, and Jie Zhou. 2020 · 2020
Cited alongside, same era.
Transformers: State-of-the-art natural language processing
Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pierric Cistac, Tim Rault, Remi Louf, Morgan Funtowicz, Joe Davison, Sam Shleifer, Patrick von Platen, Clara Ma, Yacine Jernite, Julien Plu, Canwen Xu, Teven Le Scao, Sylvain Gugger, Mariama Drame, Quentin Lhoest, and Alexander Rush. 2020 · 2020
Cited alongside, same era.
LUKE: Deep contextualized entity representations with entity-aware self-attention
Ikuya Yamada, Akari Asai, Hiroyuki Shindo, Hideaki Takeda, and Yuji Matsumoto. 2020 · 2020
Cited alongside, same era.
Ptr: Prompt tuning with rules for text classification
Original
Xu Han, Weilin Zhao, Ning Ding, Zhiyuan Liu, and Maosong Sun. 2021 · 2021
Cited alongside, same era.

Then

Re-tacred: Addressing shortcomings of the tacred dataset
George Stoica, Emmanouil Antonios Platanios, and Barnabás Póczos. 2021 · 2021
Closest in time.
A frustratingly easy approach for joint entity and relation extraction
Zexuan Zhong and Danqi Chen. 2021 · 2021
Closest in time.
An improved baseline for sentence-level relation extraction
Original
Wenxuan Zhou and Muhao Chen. 2021 · 2021
Closest in time.
Document-level relation extraction with adaptive thresholding and localized context pooling
Wenxuan Zhou, Kevin Huang, Tengyu Ma, and Jing Huang. 2021 · 2021
Closest in time.
Knowprompt: Knowledge-aware prompt-tuning with synergistic optimization for relation extraction
Xiang Chen, Ningyu Zhang, Xin Xie, Shumin Deng, Yunzhi Yao, Chuanqi Tan, Fei Huang, Luo Si, and Huajun Chen. 2022 · 2022
Closest in time.
Learning rich representation of keyphrases from text
Mayank Kulkarni, Debanjan Mahata, Ravneet Arora, and Rajarshi Bhowmik. 2022 · 2022
Closest in time.
Summarization as indirect supervision for relation extraction
Original
Keming Lu, I Hsu, Wenxuan Zhou, Mingyu Derek Ma, Muhao Chen, et al. 2022 · 2022
Closest in time.
GraphCache: Message passing as caching for sentence-level relation extraction
Yiwei Wang, Muhao Chen, Wenxuan Zhou, Yujun Cai, Yuxuan Liang, and Bryan Hooi. 2022a · 2022
Closest in time.
Should we rely on entity mentions for relation extraction? debiasing relation extraction with counterfactual analysis
Yiwei Wang, Muhao Chen, Wenxuan Zhou, Yujun Cai, Yuxuan Liang, Dayiheng Liu, Baosong Yang, Juncheng Liu, and Bryan Hooi. 2022b · 2022
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Reading the bibliography…