Inexpensive Domain Adaptation of Pretrained Language Models: Case Studies on Biomedical NER and Covid-19 QA

ClinicalBERT: Modeling clinical notes and predicting hospital readmission

Original

Kexin Huang, Jaan Altosaar, and Rajesh Ranganath. 2019a · 1904

Earlier work this paper cites.

Clinical XLNet: Modeling sequential clinical notes and predicting prolonged mechanical ventilation

Original

Kexin Huang, Abhishek Singh, Sitong Chen, Edward T Moseley, Chih-ying Deng, Naomi George, and Charlotta Lindvall. 2019b · 1912

Earlier work this paper cites.

Introduction to the bio-entity recognition task at JNLPBA

Jin-Dong Kim, Tomoko Ohta, Yoshimasa Tsuruoka, Yuka Tateisi, and Nigel Collier. 2004 · 2004

Earlier work this paper cites.

Overview of BioCreative II gene mention recognition

Larry Smith, Lorraine K Tanabe, Rie Johnson nee Ando, Cheng-Ju Kuo, I-Fang Chung, Chun-Nan Hsu, Yu-Shi Lin, Roman Klinger, Christoph M Friedrich, Kuzman Ganchev, et al. 2008 · 2008

Earlier work this paper cites.

LINNAEUS: a species name identification system for biomedical literature

Martin Gerner, Goran Nenadic, and Casey M Bergman. 2010 · 2010

Earlier work this paper cites.

The SPECIES and ORGANISMS resources for fast and accurate identification of taxonomic names in text

Evangelos Pafilis, Sune P Frankild, Lucia Fanini, Sarah Faulwetter, Christina Pavloudi, Aikaterini Vasileiadou, Christos Arvanitidis, and Lars Juhl Jensen. 2013 · 2013

Earlier work this paper cites.

NCBI disease corpus: a resource for disease name recognition and concept normalization

Rezarta Islamaj Doğan, Robert Leaman, and Zhiyong Lu. 2014 · 2014

Earlier work this paper cites.

The CHEMDNER corpus of chemicals and drugs and its annotation principles

Martin Krallinger, Obdulia Rabal, Florian Leitner, Miguel Vazquez, David Salgado, Zhiyong Lu, Robert Leaman, Yanan Lu, Donghong Ji, Daniel M Lowe, et al. 2015 · 2015

Cited alongside, same era.

BioCreative V CDR task corpus: a resource for chemical disease relation extraction

Jiao Li, Yueping Sun, Robin J Johnson, Daniela Sciaky, Chih-Hsuan Wei, Robert Leaman, Allan Peter Davis, Carolyn J Mattingly, Thomas C Wiegers, and Zhiyong Lu. 2016 · 2016

Cited alongside, same era.

SQuAD: 100,000+ questions for machine comprehension of text

Pranav Rajpurkar, Jian Zhang, Konstantin Lopyrev, and Percy Liang. 2016 · 2016

Cited alongside, same era.

Attention is all you need

Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017 · 2017

Cited alongside, same era.

Fixing weight decay regularization in Adam

Ilya Loshchilov and Frank Hutter. 2018 · 2018

Cited alongside, same era.

BERT: Pre-training of deep bidirectional transformers for language understanding

Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019 · 2019

Later among the works it cites.

Show your work: Improved reporting of experimental results

Jesse Dodge, Suchin Gururangan, Dallas Card, Roy Schwartz, and Noah A Smith. 2019 · 2019

Later among the works it cites.

Unsupervised domain adaptation of contextualized embeddings for sequence labeling

Xiaochuang Han and Jacob Eisenstein. 2019 · 2019

Later among the works it cites.

Energy and policy considerations for deep learning in NLP

Emma Strubell, Ananya Ganesh, and Andrew McCallum. 2019 · 2019

Later among the works it cites.

Improving pre-trained multilingual models with vocabulary expansion

Original

Hai Wang, Dian Yu, Kai Sun, Janshu Chen, and Dong Yu. 2019 · 2019

Later among the works it cites.