Context Variance Evaluation of Pretrained Language Models for Prompt-based Biomedical Knowledge Probing

PhysioBank, PhysioToolkit, and PhysioNet: components of a new research resource for complex physiologic signals

Goldberger AL, Amaral LA, Glass L, Hausdorff JM, Ivanov PC, Mark RG, et al · 2000

Earlier work this paper cites.

The unified medical language system (UMLS): integrating biomedical terminology

Bodenreider O · 2004

Earlier work this paper cites.

MIMIC-III, a freely accessible critical care database

Johnson AE, Pollard TJ, Shen L, Lehman LwH, Feng M, Ghassemi M, et al · 2016

Earlier work this paper cites.

Breaking the softmax bottleneck: A high-rank RNN language model

Yang Z, Dai Z, Salakhutdinov R, Cohen WW · 2017

Earlier work this paper cites.

Bert: Pre-training of deep bidirectional transformers for language understanding

Devlin J, Chang MW, Lee K, Toutanova K · 2018

Earlier work this paper cites.

Language models as knowledge bases?

Petroni F, Rocktäschel T, Lewis P, Bakhtin A, Wu Y, Miller AH, et al · 2019

Earlier work this paper cites.

Wikidata: A large-scale collaborative ontological medical database

Turki H, Shafee T, Taieb MAH, Aouicha MB, Vrandečić D, Das D, et al · 2019

Earlier work this paper cites.

Don’t Say That! Making Inconsistent Dialogue Unlikely with Unlikelihood Training

Li M, Roller S, Kulikov I, Welleck S, Boureau YL, Cho K, et al · 2019

Earlier work this paper cites.

Roberta: A robustly optimized bert pretraining approach

Liu Y, Ott M, Goyal N, Du J, Joshi M, Chen D, et al · 2019

Earlier work this paper cites.

Publicly available clinical BERT embeddings

Alsentzer E, Murphy JR, Boag W, Weng WH, Jin D, Naumann T, et al · 2019

Earlier work this paper cites.

Transfer Learning in Biomedical Natural Language Processing: An Evaluation of BERT and ELMo on Ten Benchmarking Datasets

Peng Y, Yan S, Lu Z · 2019

Cited alongside, same era.

Language models are few-shot learners

Brown T, Mann B, Ryder N, Subbiah M, Kaplan JD, Dhariwal P, et al · 2020

Cited alongside, same era.

Zero-shot entity linking with efficient long range sequence modeling

Yao Z, Cao L, Pan H · 2020

Cited alongside, same era.

BioBERT: a pre-trained biomedical language representation model for biomedical text mining

Lee J, Yoon W, Kim S, Kim D, Kim S, So CH, et al · 2020

Cited alongside, same era.

How can we know what language models know?

Jiang Z, Xu FF, Araki J, Neubig G · 2020

Cited alongside, same era.

Autoprompt: Eliciting knowledge from language models with automatically generated prompts

Shin T, Razeghi Y, Logan IV RL, Wallace E, Singh S · 2020

Can Language Models be Biomedical Knowledge Bases?

Sung M, Lee J, Yi S, Jeon M, Kim S, Kang J · 2021

Later among the works it cites.

Factual probing is [MASK]: Learning vs. learning to recall

Zhong Z, Friedman D, Chen D · 2021

Later among the works it cites.

Knowledgeable or educated guess? revisiting language models as knowledge bases

Cao B, Lin H, Han X, Sun L, Yan L, Liao M, et al · 2021

Later among the works it cites.

Rewire-then-Probe: A Contrastive Recipe for Probing Biomedical Knowledge of Pre-trained Language Models

Meng Z, Liu F, Shareghi E, Su Y, Collins C, Collier N · 2021

Later among the works it cites.

Comparative toxicogenomics database (CTD): update 2021

Davis AP, Grondin CJ, Johnson RJ, Sciaky D, Wiegers J, Wiegers TC, et al · 2021

Later among the works it cites.

Training dynamics for text summarization models

Goyal T, Xu J, Li JJ, Durrett G · 2021