Fetching the paper…
Reading the bibliography…
In this work, we aim at equipping pre-trained language models with structured knowledge.
ERNIE: enhanced representation through knowledge integration
Yu Sun, Shuohuan Wang, Yukun Li, Shikun Feng, Xuyi Chen, Han Zhang, Xin Tian, Danxiang Zhu, Hao Tian, and Hua Wu · 1904
Earlier work this paper cites.
Xlnet: Generalized autoregressive pretraining for language understanding
Zhilin Yang, Zihang Dai, Yiming Yang, Jaime G. Carbonell, Ruslan Salakhutdinov, and Quoc V. Le · 1906
Earlier work this paper cites.
Spanbert: Improving pre-training by representing and predicting spans
Mandar Joshi, Danqi Chen, Yinhan Liu, Daniel S. Weld, Luke Zettlemoyer, and Omer Levy · 1907
Earlier work this paper cites.
Roberta: A robustly optimized BERT pretraining approach
Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov · 1907
Earlier work this paper cites.
ERNIE 2.0: A continual pre-training framework for language understanding
Yu Sun, Shuohuan Wang, Yukun Li, Shikun Feng, Hao Tian, Hua Wu, and Haifeng Wang · 1907
Earlier work this paper cites.
Zhi-Xiu Ye, Qian Chen, Wen Wang, and Zhen-Hua Ling · 1908
Earlier work this paper cites.
K-BERT: enabling language representation with knowledge graph
Weijie Liu, Peng Zhou, Zhe Zhao, Zhiruo Wang, Qi Ju, Haotang Deng, and Ping Wang · 1909
Earlier work this paper cites.
Graph-based reasoning over heterogeneous external knowledge for commonsense question answering
Shangwen Lv, Daya Guo, Jingjing Xu, Duyu Tang, Nan Duan, Ming Gong, Linjun Shou, Daxin Jiang, Guihong Cao, and Songlin Hu · 1909
Earlier work this paper cites.
Arindam Mitra, Pratyay Banerjee, Kuntal Kumar Pal, Swaroop Mishra, and Chitta Baral · 1909
Earlier work this paper cites.
KG-BERT: BERT for knowledge graph completion
Liang Yao, Chengsheng Mao, and Yuan Luo · 1909
Earlier work this paper cites.
Freelb: Enhanced adversarial training for language understanding
Chen Zhu, Yu Cheng, Zhe Gan, Siqi Sun, Tom Goldstein, and Jingjing Liu · 1909
Earlier work this paper cites.
Exploiting structural and semantic context for commonsense knowledge base completion
Chaitanya Malaviya, Chandra Bhagavatula, Antoine Bosselut, and Yejin Choi · 1910
Earlier work this paper cites.
WordNet: An electronic lexical database
George A Miller · 1998
Earlier work this paper cites.
Freebase: a collaboratively created graph database for structuring human knowledge
Kurt D Bollacker, Colin Evans, Praveen Paritosh, Tim Sturge, and Jamie Taylor · 2008
Earlier work this paper cites.
Distant supervision for relation extraction without labeled data
Mike Mintz, Steven Bills, Rion Snow, and Daniel Jurafsky · 2009
Earlier work this paper cites.
Translating Embeddings for Modeling Multi-relational Data
Antoine Bordes, Nicolas Usunier, Alberto Garcia-Durán, Jason Weston, and Oksana Yakhnenko · 2013
Earlier work this paper cites.
Reasoning With Neural Tensor Networks for Knowledge Base Completion
Richard Socher, Danqi Chen, Christopher D Manning, and Andrew Y Ng · 2013
Earlier work this paper cites.
Knowledge graph and text jointly embedding
Zhen Wang, Jianwen Zhang, Jianlin Feng, and Zheng Chen · 2014
Cited alongside, same era.
Representing text for joint embedding of text and knowledge bases
Kristina Toutanova, Danqi Chen, Patrick Pantel, Hoifung Poon, Pallavi Choudhury, and Michael Gamon · 2015
Cited alongside, same era.
Embedding Entities and Relations for Learning and Inference in Knowledge Bases
Bishan Yang, Wen-tau Yih, Xiaodong He, Jianfeng Gao, and Li Deng · 2015
Cited alongside, same era.
S-MART: novel tree-based structured learning algorithms applied to tweet entity linking
Yi Yang and Ming-Wei Chang · 2015
Cited alongside, same era.
Commonsense Knowledge Base Completion
Xiang Li, Aynaz Taheri, Lifu Tu, and Kevin Gimpel · 2016
Cited alongside, same era.
Neural machine translation of rare words with subword units
Modeling Relational Data with Graph Convolutional Networks
Michael Sejr Schlichtkrull, Thomas N Kipf, Peter Bloem, Rianne van den Berg, Ivan Titov, and Max Welling · 2018
Later among the works it cites.
DOLORES: deep contextualized knowledge graph embeddings
Haoyu Wang, Vivek Kulkarni, and William Yang Wang · 2018
Later among the works it cites.
COMET: Commonsense Transformers for Automatic Knowledge Graph Construction
Antoine Bosselut, Hannah Rashkin, Maarten Sap, Chaitanya Malaviya, Asli Çelikyilmaz, and Yejin Choi · 2019
Later among the works it cites.
Commonsense knowledge mining from pretrained models
Joe Davison, Joshua Feldman, and Alexander Rush · 2019
Later among the works it cites.
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova · 2019
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Rico Sennrich, Barry Haddow, and Alexandra Birch · 2016
Cited alongside, same era.
Complex Embeddings for Simple Link Prediction
Théo Trouillon, Johannes Welbl, Sebastian Riedel, Éric Gaussier, and Guillaume Bouchard · 2016
Cited alongside, same era.
Joint learning of the embedding of words and entities for named entity disambiguation
Ikuya Yamada, Hiroyuki Shindo, Hideaki Takeda, and Yoshiyasu Takefuji · 2016
Cited alongside, same era.
ConceptNet 5.5: An Open Multilingual Graph of General Knowledge
Robyn Speer, Joshua Chin, and Catherine Havasi · 2017
Cited alongside, same era.
Accurate text-enhanced knowledge graph representation learning
Bo An, Bo Chen, Xianpei Han, and Le Sun · 2018
Cited alongside, same era.
KBGAN: adversarial learning for knowledge graph embeddings
Liwei Cai and William Yang Wang · 2018
Cited alongside, same era.
Think you have solved question answering? try arc, the AI2 reasoning challenge
Peter Clark, Isaac Cowhey, Oren Etzioni, Tushar Khot, Ashish Sabharwal, Carissa Schoenick, and Oyvind Tafjord · 2018
Cited alongside, same era.
KagNet: Knowledge-aware graph networks for commonsense reasoning
Bill Yuchen Lin, Xinyue Chen, Jamin Chen, and Xiang Ren · 2019
Later among the works it cites.
Learning Attention-based Embeddings for Relation Prediction in Knowledge Graphs
Deepak Nathani, Jatin Chauhan, Charu Sharma, and Manohar Kaul · 2019
Later among the works it cites.
Knowledge enhanced contextual word representations
Matthew E. Peters, Mark Neumann, Robert Logan, Roy Schwartz, Vidur Joshi, Sameer Singh, and Noah A. Smith · 2019
Later among the works it cites.
Language models as knowledge bases?
Fabio Petroni, Tim Rocktäschel, Sebastian Riedel, Patrick Lewis, Anton Bakhtin, Yuxiang Wu, and Alexander Miller · 2019
Later among the works it cites.
Explain Yourself! Leveraging Language Models for Commonsense Reasoning
Nazneen Fatema Rajani, Bryan McCann, Caiming Xiong, and Richard Socher · 2019
Later among the works it cites.
Social IQa: Commonsense reasoning about social interactions
Maarten Sap, Hannah Rashkin, Derek Chen, Ronan Le Bras, and Yejin Choi · 2019
Later among the works it cites.
Rotate: Knowledge graph embedding by relational rotation in complex space
Zhiqing Sun, Zhi-Hong Deng, Jian-Yun Nie, and Jian Tang · 2019
Later among the works it cites.
CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledge
Alon Talmor, Jonathan Herzig, Nicholas Lourie, and Jonathan Berant · 2019
Later among the works it cites.
Hellaswag: Can a machine really finish your sentence?
Rowan Zellers, Ari Holtzman, Yonatan Bisk, Ali Farhadi, and Yejin Choi · 2019
Later among the works it cites.
ERNIE: Enhanced Language Representation with Informative Entities
Zhengyan Zhang, Xu Han, Zhiyuan Liu, Xin Jiang, Maosong Sun, and Qun Liu · 2019
Later among the works it cites.
A Novel Embedding Model for Knowledge Base Completion Based on Convolutional Neural Network
Dai Quoc Nguyen, Tu Dinh Nguyen, Dat Quoc Nguyen, and Dinh Q Phung · 2053
Closest in time.