Improving Zero-Shot Detection of Low Prevalence Chest Pathologies using Domain Pre-trained Language Models

Built on

Publicly available clinical BERT embeddings
Original
Emily Alsentzer, John R. Murphy, Willie Boag, Wei-Hung Weng, Di Jin, Tristan Naumann, and Matthew B. A. McDermott · 1904
Earlier work this paper cites.
Transfer learning in biomedical natural language processing: An evaluation of BERT and elmo on ten benchmarking datasets
Original
Yifan Peng, Shankai Yan, and Zhiyong Lu · 1906
Earlier work this paper cites.
Chexbert: Combining automatic labelers and expert annotations for accurate radiology report labeling using BERT
Original
Akshay Smit, Saahil Jain, Pranav Rajpurkar, Anuj Pareek, Andrew Y. Ng, and Matthew P. Lungren · 2004
Earlier work this paper cites.

A survey on deep learning in medical image analysis
Geert Litjens, Thijs Kooi, Babak Ehteshami Bejnordi, Arnaud Arindra Adiyoso Setio, Francesco Ciompi, Mohsen Ghafoorian, Jeroen A.W.M. van der Laak, Bram van Ginneken, and Clara I. Sánchez · 2017
Cited alongside, same era.
Chexnet: Radiologist-level pneumonia detection on chest x-rays with deep learning, 2017
Original
Pranav Rajpurkar, Jeremy Irvin, Kaylie Zhu, Brandon Yang, Hershel Mehta, Tony Duan, Daisy Ding, Aarti Bagul, Curtis Langlotz, Katie Shpanskaya, Matthew P. Lungren, and Andrew Y. Ng · 2017
Cited alongside, same era.
Learning transferable visual models from natural language supervision
Original
Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, Gretchen Krueger, and Ilya Sutskever · 2021
Cited alongside, same era.

Making the most of text semantics to improve biomedical vision–language processing, 2022
Original
Benedikt Boecking, Naoto Usuyama, Shruthi Bannur, Daniel C. Castro, Anton Schwaighofer, Stephanie Hyland, Maria Wetscherek, Tristan Naumann, Aditya Nori, Javier Alvarez-Valle, Hoifung Poon, and Ozan Oktay · 2022
Later among the works it cites.
Expert-level detection of pathologies from unannotated chest x-ray images via self-supervised learning
Original
Ekin Tiu, Ellie Talius, Pujan Patel, Curtis Langlotz, Andrew Ng, and Pranav Rajpurkar · 2022
Later among the works it cites.