2019

Improving Neural Relation Extraction with Implicit Mutual Relations

Kuang, Jun, Cao, Yixin, Zheng, Jianbing et al.

Understand

Relation extraction (RE) aims at extracting the relation between two entities from the text corpora.

It is a crucial task for Knowledge Graph (KG) construction.
Most existing methods predict the relation between an entity pair by learning the relation from the training sentences, which contain the targeted entity pair.
In contrast to existing distant supervision approaches that suffer from insufficient training corpora to extract relations, our proposal of mining implicit mutual relation from the massive unlabeled corpora transfers the semantic information of entity pairs into the RE model, which is more expressive and semantically plausible.

Built on

N. Kambhatla, “Combining lexical, syntactic, and semantic features with maximum entropy models for extracting relations,” in Proceedings of the ACL 2004 on Interactive Poster and Demonstration Sessions , ser. ACLdemo ’04. Stroudsburg, PA, USA: Association for Computational Linguistics, 2004. [Online]. Available: http://dx.doi.org/10.3115/1219044.1219066
2004
Earlier work this paper cites.
S. Auer, C. Bizer, G. Kobilarov, J. Lehmann, R. Cyganiak, and Z. Ives, “Dbpedia: A nucleus for a web of open data,” in Proceedings of the 6th International The Semantic Web and 2Nd Asian Conference on Asian Semantic Web Conference , ser. ISWC’07/ASWC’07. Berlin, Heidelberg: Springer-Verlag, 2007, pp. 722–735. [Online]. Available: http://dl.acm.org/citation.cfm?id=1785162.1785216
2007
Earlier work this paper cites.
F. M. Suchanek, G. Kasneci, and G. Weikum, “Yago: A core of semantic knowledge,” in Proceedings of the 16th International Conference on World Wide Web , ser. WWW ’07. New York, NY, USA: ACM, 2007, pp. 697–706. [Online]. Available: http://doi.acm.org/10.1145/1242572.1242667
2007
Earlier work this paper cites.
D. N. Milne, I. H. Witten, and D. M. Nichols, “A knowledge-based search engine powered by wikipedia,” in Proceedings of the sixteenth ACM conference on Conference on information and knowledge management . ACM, 2007, pp. 445–454
2007
Earlier work this paper cites.
J. Huang, M. Zhou, and D. Yang, “Extracting chatbot knowledge from online discussion forums.” in IJCAI , vol. 7, 2007, pp. 423–428
2007
Earlier work this paper cites.
N. Bach and S. Badaskar, “A review of relation extraction,” Literature review for Language and Statistics II , vol. 2, 2007
2007
Earlier work this paper cites.
K. Bollacker, C. Evans, P. Paritosh, T. Sturge, and J. Taylor, “Freebase: A collaboratively created graph database for structuring human knowledge,” in Proceedings of the 2008 ACM SIGMOD International Conference on Management of Data , ser. SIGMOD ’08. New York, NY, USA: ACM, 2008, pp. 1247–1250. [Online]. Available: http://doi.acm.org/10.1145/1376616.1376746
2008
Earlier work this paper cites.
M. Mintz, S. Bills, R. Snow, and D. Jurafsky, “Distant supervision for relation extraction without labeled data,” in Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume . Association for Computational Linguistics., 2009, pp. 1003–1011
2009
Earlier work this paper cites.
S. Riedel, L. Yao, and A. McCallum, “Modeling relations and their mentions without labeled text,” in Proceedings of the 2010 European Conference on Machine Learning and Knowledge Discovery in Databases: Part III , ser. ECML PKDD’10. Berlin, Heidelberg: Springer-Verlag, 2010, pp. 148–163. [Online]. Available: http://dl.acm.org/citation.cfm?id=1889788.1889799
2010
Earlier work this paper cites.
R. Hoffmann, C. Zhang, X. Ling, L. Zettlemoyer, and D. S. Weld, “Knowledge-based weak supervision for information extraction of overlapping relations,” in Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies - Volume 1 , ser. HLT ’11. Stroudsburg, PA, USA: Association for Computational Linguistics, 2011, pp. 541–550. [Online]. Available: http://dl.acm.org/citation.cfm?id=2002472.2002541
2011
Earlier work this paper cites.
R. Socher, B. Huval, C. D. Manning, and A. Y. Ng, “Semantic compositionality through recursive matrix-vector spaces,” in Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning , ser. EMNLP-CoNLL ’12. Stroudsburg, PA, USA: Association for Computational Linguistics, 2012, pp. 1201–1211. [Online]. Available: http://dl.acm.org/citation.cfm?id=2390948.2391084
2012
Earlier work this paper cites.
M. Surdeanu, J. Tibshirani, R. Nallapati, and C. D. Manning, “Multi-instance multi-label learning for relation extraction,” in Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning , ser. EMNLP-CoNLL ’12. Stroudsburg, PA, USA: Association for Computational Linguistics, 2012, pp. 455–465. [Online]. Available: http://dl.acm.org/citation.cfm?id=2390948.2391003
2012
Earlier work this paper cites.
X. Ling and D. S. Weld., “Fine-grained entity recognition,” in AAAI’12 . AAAI Press, 2012, pp. 84–100
2012
Earlier work this paper cites.
T. Mikolov, I. Sutskever, K. Chen, G. S. Corrado, and J. Dean, “Distributed representations of words and phrases and their compositionality,” in Advances in neural information processing systems , 2013, pp. 3111–3119
2013
Earlier work this paper cites.
W. Shen, J. Wang, and J. Han, “Entity linking with a knowledge base: Issues, techniques, and solutions,” IEEE Transactions on Knowledge and Data Engineering , vol. 27, no. 2, pp. 443–460, 2014
2014
Earlier work this paper cites.
D. Zeng, K. Liu, S. Lai, G. Zhou, and J. Zhao, “Relation classification via convolutional deep neural network.” in Proceeding of the 25th International Conference on Computational Linguistics: Technical Papers , 2014, pp. 2335–2344
2014
Earlier work this paper cites.

Similar

J. Pennington, R. Socher, and C. Manning, “Glove: Global vectors for word representation.” in Proceding of the 2014 conference on empirical methods in natural language processing , 2014, pp. 1532–1543
2014
Cited alongside, same era.
N. Konstantinova, “Review of relation extraction methods: What is new out there?” in Analysis of Images, Social Networks and Texts , D. I. Ignatov, M. Y. Khachay, A. Panchenko, N. Konstantinova, and R. E. Yavorsky, Eds. Cham: Springer International Publishing, 2014, pp. 15–28
2014
Cited alongside, same era.
V. Mnih, N. Heess, A. Graves et al. , “Recurrent models of visual attention,” in Advances in neural information processing systems , 2014, pp. 2204–2212
2014
Cited alongside, same era.
I. J. Goodfellow, J. Shlens, and C. Szegedy, “Explaining and harnessing adversarial examples,” arXiv preprint arXiv:1412.6572 , 2014
Original
2014
Cited alongside, same era.
I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, and Y. Bengio, “Generative adversarial nets,” in Advances in neural information processing systems , 2014, pp. 2672–2680
2014
Cited alongside, same era.
Y. Liu, K. Liu, L. Xu, and J. Zhao, “Exploring fine-grained entity type constraints for distantly supervised relation extraction,” in Proceedings of COLING 2014, the 25th International Conference on Computational Linguistics: Technical Papers , 2014, pp. 2107–2116
2014
Cited alongside, same era.
D. Zeng, K. Liu, Y. Chen, and J. Zhao, “Distant supervision for relation extraction via piecewise convolutional neural networks.” in Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing , 2015, pp. 1753–1762
2015
Cited alongside, same era.
C. N. d. Santos, B. Xiang, and B. Zhou, “Classifying relations by ranking with convolutional neural networks,” arXiv preprint arXiv:1504.06580 , 2015
Original
2015
Cited alongside, same era.
T. H. Nguyen and R. Grishman, “Relation extraction: Perspective from convolutional neural networks,” in Proceedings of the 1st Workshop on Vector Space Modeling for Natural Language Processing , 2015, pp. 39–48
2015
Cited alongside, same era.
J. Tang, M. Qu, M. Wang, and et al., “Line: Large-scale information network embedding,” in Proceedings of the 24th International Conference on World Wide Web . International World Wide Web Conferences Steering Committee., 2015, pp. 1067–1077
2015
Cited alongside, same era.
P. Zhou, W. Shi, J. Tian, Z. Qi, B. Li, H. Hao, and B. Xu, “Attention-based bidirectional long short-term memory networks for relation classification,” in Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) , 2016, pp. 207–212
2016
Cited alongside, same era.
Y. Lin, S. Shen, Z. Liu, H. Luan, and M. Sun, “Neural relation extraction with selective attention over instances.” in Proceeding of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) , 2016, pp. 2124–2133
2016
Cited alongside, same era.

Then

W. Zeng, Y. Lin, Z. Liu, and M. Sun, “Incorporating relation paths in neural relation extraction,” in Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing . Association for Computational Linguistics, 2017, pp. 1768–1777
2017
Later among the works it cites.
G. Ji, K. Liu, S. He, and J. Zhao, “Distant supervision for relation extraction with sentence-level attention and entity descriptions,” in Thirty-First AAAI Conference on Artificial Intelligence , 2017
2017
Later among the works it cites.
Y. Yadollah, H. Adel, and H. Schütze., “Noise mitigation for neural entity typing and relation extraction.” in the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1, . Association for Computational Linguistics, 2017, pp. 1183–1194
2017
Later among the works it cites.
Y. Wu, D. Bamman, and S. Russell, “Adversarial training for relation extraction,” in Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing , 2017, pp. 1778–1783
2017
Later among the works it cites.
M. M. Bronstein, J. Bruna, Y. LeCun, A. Szlam, and P. Vandergheynst, “Geometric deep learning: going beyond euclidean data,” IEEE Signal Processing Magazine , vol. 34, no. 4, pp. 18–42, 2017
2017
Later among the works it cites.
P. Veličković, G. Cucurull, A. Casanova, A. Romero, P. Lio, and Y. Bengio, “Graph attention networks,” arXiv preprint arXiv:1710.10903 , 2017
Original
2017
Later among the works it cites.
J. Devlin, M.-W. Chang, K. Lee, and K. Toutanova, “Bert: Pre-training of deep bidirectional transformers for language understanding,” arXiv preprint arXiv:1810.04805 , 2018
Original
2018
Later among the works it cites.
F. Christopoulou, M. Miwa, and S. Ananiadou, “A walk-based model on entity graphs for relation extraction,” in Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) . Association for Computational Linguistics, 2018, pp. 81–88
2018
Later among the works it cites.
S. Vashishth, R. Joshi, S. S. Prayaga, C. Bhattacharyya, and P. Talukdar, “Reside: Improving distantly-supervised neural relation extraction using side information,” in Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing . Association for Computational Linguistics, 2018, pp. 1257–1266
2018
Later among the works it cites.
T. Liu, X. Zhang, W. Zhou, and W. Jia, “Neural relation extraction via inner-sentence noise reduction and transfer learning,” in Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing . Association for Computational Linguistics, 2018, pp. 2195–2204. [Online]. Available: http://aclweb.org/anthology/D18-1243
2018
Later among the works it cites.
J. Du, J. Han, A. Way, and D. Wan, “Multi-level structured self-attentions for distantly supervised relation extraction,” in Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing . Association for Computational Linguistics, 2018, pp. 2216–2225. [Online]. Available: http://aclweb.org/anthology/D18-1245
2018
Later among the works it cites.
J. Feng, M. Huang, Z. Li, Y. Yang, and X. Zhu, “Reinforcement learning for relation classification from noisy data,” in Proceeding of The Thirty- Second AAAI Conference on Artificial Intelligence (AAAI-18) , 2018, pp. 5779–5786
2018
Later among the works it cites.
P. Qin, W. Xu, and W. Y. Wang, “Robust distant supervision relation extraction via deep reinforcement learning,” in ACL , 2018
2018
Later among the works it cites.
P. Qin, W. Xu, and W. Y. Wang, “Dsgan: Generative adversarial training for distant supervision relation extraction,” arXiv preprint arXiv:1805.09929 , 2018
Original
2018
Later among the works it cites.
Y. Pinter and J. Eisenstein, “Predicting semantic relations using global graph properties,” in Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing . Association for Computational Linguistics, 2018, pp. 1741–1751
2018
Later among the works it cites.
S. Jat, S. Khandelwal, and P. Talukdar, “Improving distantly supervised relation extraction using word and entity based attention,” arXiv preprint arXiv:1804.06987 , 2018
Original
2018
Later among the works it cites.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Reading the bibliography…