Fetching the paper…
Reading the bibliography…
In recent years, transformer-based language models have achieved state of the art performance in various NLP benchmarks.
Tucker: Tensor factorization for knowledge graph completion
Balažević, Ivana, Carl Allen, and Timothy M Hospedales. 2019 · 1901
Earlier work this paper cites.
Transformer-xl: Attentive language models beyond a fixed-length context
Dai, Zihang, Zhilin Yang, Yiming Yang, Jaime Carbonell, Quoc V Le, and Ruslan Salakhutdinov. 2019 · 1901
Earlier work this paper cites.
Parameter-efficient transfer learning for nlp
Houlsby, Neil, Andrei Giurgiu, Stanislaw Jastrzebski, Bruna Morrone, Quentin De Laroussilhe, Andrea Gesmundo, Mona Attariyan, and Sylvain Gelly. 2019 · 1902
Earlier work this paper cites.
Mcscript2. 0: A machine comprehension corpus focused on script events and participants
Ostermann, Simon, Michael Roth, and Manfred Pinkal. 2019 · 1905
Earlier work this paper cites.
Comet: Commonsense transformers for automatic knowledge graph construction
Bosselut, Antoine, Hannah Rashkin, Maarten Sap, Chaitanya Malaviya, Asli Celikyilmaz, and Yejin Choi. 2019 · 1906
Earlier work this paper cites.
Ye, Zhi-Xiu, Qian Chen, Wen Wang, and Zhen-Hua Ling. 2019 · 1908
Earlier work this paper cites.
Informing unsupervised pretraining with external linguistic knowledge
Lauscher, Anne, Ivan Vulić, Edoardo Maria Ponti, Anna Korhonen, and Goran Glavaš. 2019 · 1909
Earlier work this paper cites.
Knowledge enhanced contextual word representations
Peters, Matthew E, Mark Neumann, Robert L Logan IV, Roy Schwartz, Vidur Joshi, Sameer Singh, and Noah A Smith. 2019 · 1909
Earlier work this paper cites.
Language models as knowledge bases?
Petroni, Fabio, Tim Rocktäschel, Patrick Lewis, Anton Bakhtin, Yuxiang Wu, Alexander H Miller, and Sebastian Riedel. 2019 · 1909
Earlier work this paper cites.
Kg-bert: Bert for knowledge graph completion
Yao, Liang, Chengsheng Mao, and Yuan Luo. 2019 · 1909
Earlier work this paper cites.
Semantics-aware bert for language understanding
Zhang, Zhuosheng, Yuwei Wu, Hai Zhao, Zuchao Li, Shuailiang Zhang, Xi Zhou, and Xiang Zhou. 2019 · 1909
Earlier work this paper cites.
Da, Jeff and Jungo Kusai. 2019 · 1910
Earlier work this paper cites.
Dynamic knowledge graph construction for zero-shot commonsense question answering
Bosselut, Antoine and Yejin Choi. 2019 · 1911
Earlier work this paper cites.
Integrating graph contextualized knowledge into pre-trained language models
He, Bin, Di Zhou, Jinghui Xiao, Qun Liu, Nicholas Jing Yuan, Tong Xu, et al. 2019 · 1912
Earlier work this paper cites.
WordNet: An electronic lexical database
Miller, George A. 1998 · 1998
Earlier work this paper cites.
Byte pair encoding: A text compression scheme that accelerates pattern matching
Shibata, Yusuxke, Takuya Kida, Shuichi Fukamachi, Masayuki Takeda, Ayumi Shinohara, Takeshi Shinohara, and Setsuo Arikawa. 1999 · 1999
Cited alongside, same era.
Open mind common sense: Knowledge acquisition from the general public
Singh, Push, Thomas Lin, Erik T Mueller, Grace Lim, Travell Perkins, and Wan Li Zhu. 2002 · 2002
Cited alongside, same era.
K-adapter: Infusing knowledge into pre-trained models with adapters
Wang, Ruize, Duyu Tang, Nan Duan, Zhongyu Wei, Xuanjing Huang, Cuihong Cao, Daxin Jiang, Ming Zhou, et al. 2020 · 2002
Cited alongside, same era.
Hogan, Aidan, Eva Blomqvist, Michael Cochez, Claudia d’Amato, Gerard de Melo, Claudio Gutierrez, José Emilio Labra Gayo, Sabrina Kirrane, Sebastian Neumaier, Axel Polleres, et al. 2020 · 2003
Cited alongside, same era.
The unified medical language system (umls): integrating biomedical terminology
Race: Large-scale reading comprehension dataset from examinations
Lai, Guokun, Qizhe Xie, Hanxiao Liu, Yiming Yang, and Eduard Hovy. 2017 · 2017
Later among the works it cites.
Conceptnet 5.5: An open multilingual graph of general knowledge
Speer, Robyn, Joshua Chin, and Catherine Havasi. 2017 · 2017
Later among the works it cites.
Attention is all you need
Vaswani, Ashish, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017 · 2017
Later among the works it cites.
Bert: Pre-training of deep bidirectional transformers for language understanding
Devlin, Jacob, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018 · 2018
Later among the works it cites.
Improving language understanding by generative pre-training
Radford, Alec, Karthik Narasimhan, Tim Salimans, and Ilya Sutskever. 2018 · 2018
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Bodenreider, Olivier. 2004 · 2004
Cited alongside, same era.
Exploiting structured knowledge in text via graph-guided representation learning
Shen, Tao, Yi Mao, Pengcheng He, Guodong Long, Adam Trischler, and Weizhu Chen. 2020 · 2004
Cited alongside, same era.
Lauscher, Anne, Olga Majewska, Leonardo FR Ribeiro, Iryna Gurevych, Nikolai Rozanov, and Goran Glavaš. 2020 · 2005
Cited alongside, same era.
Knowledge-aware language model pretraining
Rosset, Corby, Chenyan Xiong, Minh Phan, Xia Song, Paul Bennett, and Saurabh Tiwary. 2020 · 2007
Cited alongside, same era.
Freebase: a collaboratively created graph database for structuring human knowledge
Bollacker, Kurt, Colin Evans, Praveen Paritosh, Tim Sturge, and Jamie Taylor. 2008 · 2008
Cited alongside, same era.
Semantic role labeling: an introduction to the special issue
Màrquez, Lluís, Xavier Carreras, Kenneth C Litkowski, and Suzanne Stevenson. 2008 · 2008
Cited alongside, same era.
Representing general relational knowledge in conceptnet 5
Speer, Robyn and Catherine Havasi. 2012 · 2012
Cited alongside, same era.
Facc1: Freebase annotation of clueweb corpora, version 1 (release date 2013-06-26, format version 1, correction level 0)
Gabrilovich, Evgeniy, Michael Ringgaard, and Amarnag Subramanya. 2013 · 2013
Cited alongside, same era.
Commonsense knowledge mining from pretrained models
Davison, Joe, Joshua Feldman, and Alexander M Rush. 2019 · 2019
Later among the works it cites.
T-rex: A large scale alignment of natural language with knowledge base triples
Elsahar, Hady, Pavlos Vougiouklis, Arslen Remaci, Christophe Gravier, Jonathon Hare, Elena Simperl, and Frederique Laforest. 2019 · 2019
Later among the works it cites.
A structural probe for finding syntax in word representations
Hewitt, John and Christopher D Manning. 2019 · 2019
Later among the works it cites.
Metalearned neural memory
Munkhdalai, Tsendsuren, Alessandro Sordoni, Tong Wang, and Adam Trischler. 2019 · 2019
Later among the works it cites.
Atomic: An atlas of machine commonsense for if-then reasoning
Sap, Maarten, Ronan Le Bras, Emily Allaway, Chandra Bhagavatula, Nicholas Lourie, Hannah Rashkin, Brendan Roof, Noah A Smith, and Yejin Choi. 2019 · 2019
Later among the works it cites.
Xlnet: Generalized autoregressive pretraining for language understanding
Yang, Zhilin, Zihang Dai, Yiming Yang, Jaime Carbonell, Russ R Salakhutdinov, and Quoc V Le. 2019 · 2019
Later among the works it cites.
K-bert: Enabling language representation with knowledge graph
Liu, Weijie, Peng Zhou, Zhe Zhao, Zhiruo Wang, Qi Ju, Haotang Deng, and Ping Wang. 2020 · 2020
Later among the works it cites.
Graph-based reasoning over heterogeneous external knowledge for commonsense question answering
Lv, Shangwen, Daya Guo, Jingjing Xu, Duyu Tang, Nan Duan, Ming Gong, Linjun Shou, Daxin Jiang, Guihong Cao, and Songlin Hu. 2020 · 2020
Later among the works it cites.
Commonsense knowledge base completion with structural and semantic context
Malaviya, Chaitanya, Chandra Bhagavatula, Antoine Bosselut, and Yejin Choi. 2020 · 2020
Later among the works it cites.
Ernie 2.0: A continual pre-training framework for language understanding
Sun, Yu, Shuohuan Wang, Yu-Kun Li, Shikun Feng, Hao Tian, Hua Wu, and Haifeng Wang. 2020 · 2020
Later among the works it cites.