Fetching the paper…
Reading the bibliography…
The advancement of natural language processing (NLP) systems in healthcare hinges on language model ability to interpret the intricate information contained within clinical notes.
Language models are few-shot learners
Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel Ziegler, Jeffrey Wu, Clemens Winter, Chris Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei. 2020 · 1901
Earlier work this paper cites.
Clinicalbert: Modeling clinical notes and predicting hospital readmission
Kexin Huang, Jaan Altosaar, and Rajesh Ranganath. 2019 · 1904
Earlier work this paper cites.
What every teacher needs to know about clinical reasoning
K. Eva. 2005 · 2005
Earlier work this paper cites.
Launching hitech
David Blumenthal. 2010 · 2010
Earlier work this paper cites.
Long range arena: A benchmark for efficient transformers
Yi Tay, Mostafa Dehghani, Samira Abnar, Yikang Shen, Dara Bahri, Philip Pham, Jinfeng Rao, Liu Yang, Sebastian Ruder, and Donald Metzler. 2020 · 2011
Earlier work this paper cites.
Mimic-iii, a freely accessible critical care database
Alistair E. W. Johnson, Tom J. Pollard, Lu Shen, Li wei H. Lehman, Mengling Feng, Mohammad Mahdi Ghassemi, Benjamin Moody, Peter Szolovits, Leo Anthony Celi, and Roger G. Mark. 2016 · 2016
Earlier work this paper cites.
Explainable prediction of medical codes from clinical text
James Mullenbach, Sarah Wiegreffe, Jon Duke, Jimeng Sun, and Jacob Eisenstein. 2018 · 2018
Earlier work this paper cites.
Publicly available clinical BERT embeddings
Emily Alsentzer, John Murphy, William Boag, Wei-Hung Weng, Di Jindi, Tristan Naumann, and Matthew McDermott. 2019 · 2019
Earlier work this paper cites.
Document-level n-ary relation extraction with multiscale representation learning
Robin Jia, Cliff Wong, and Hoifung Poon. 2019 · 2019
Earlier work this paper cites.
Pretraining to recognize pico elements from randomized controlled trial literature
Tian Kang, Shirui Zou, and Chunhua Weng. 2019 · 2019
Earlier work this paper cites.
Fine-tuning bidirectional encoder representations from transformers (bert)–based models on large-scale electronic health record notes: An empirical study
Fei Li, Yonghao Jin, Weisong Liu, Bhanu Pratap Singh Rawat, Pengshan Cai, and Hong Yu. 2019 · 2019
Earlier work this paper cites.
Clinical concept extraction for document-level coding
Sarah Wiegreffe, Edward Choi, Sherry Yan, Jimeng Sun, and Jacob Eisenstein. 2019 · 2019
Earlier work this paper cites.
Deep learning in clinical natural language processing: a methodical review
Stephen T Wu, Kirk Roberts, Surabhi Datta, Jingcheng Du, Zongcheng Ji, Yuqi Si, Sarvesh Soni, Qiong Wang, Qiang Wei, Yang Xiang, Bo Zhao, and Hua Xu. 2019 · 2019
Earlier work this paper cites.
Clinical concept extraction: A methodology review
Sunyang Fu, David C. Chen, Huan He, Sijia Liu, Sungrim Moon, Kevin J. Peterson, Feichen Shen, Liwei Wang, Yanshan Wang, Andrew Wen, Yiqing Zhao, Sunghwan Sohn, and Hongfang Liu. 2020 · 2020
Earlier work this paper cites.
Pretrained language models for biomedical and clinical tasks: Understanding and extending the state-of-the-art
Patrick Lewis, Myle Ott, Jingfei Du, and Veselin Stoyanov. 2020 · 2020
Cited alongside, same era.
Icd coding from clinical text using multi-filter residual convolutional neural network
Fei Li and Hong Yu. 2020 · 2020
Cited alongside, same era.
Making pre-trained language models better few-shot learners
Tianyu Gao, Adam Fisch, and Danqi Chen. 2021 · 2021
Cited alongside, same era.
Lora: Low-rank adaptation of large language models
J. Edward Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, and Weizhu Chen. 2021 · 2021
Cited alongside, same era.
The power of scale for parameter-efficient prompt tuning
Brian Lester, Rami Al-Rfou, and Noah Constant. 2021 · 2021
Cited alongside, same era.
Domain-specific continued pretraining of language models for capturing long context in mental health
Shaoxiong Ji, Tianlin Zhang, Kailai Yang, Sophia Ananiadou, E. Cambria, and Jörg Tiedemann. 2023 · 2023
Later among the works it cites.
Health system-scale language models are all-purpose prediction engines
Lavender Yao Jiang, Xujin C. Liu, Nima Pour Nejatian, Mustafa Nasir-Moin, Duo Wang, Anas Abidin, Kevin Eaton, Howard A. Riina, Ilya Laufer, Paawan Punjabi, Madeline Miceli, Nora C. Kim, Cordelia Orillac, Zane Schnurman, Christopher Livia, Hannah Weiss, David Kurland, Sean N. Neifert, Yosef Dastagirzada, Douglas Kondziolka, Alexander T. M. Cheung, Grace Yang, Mingzi Cao, Mona G. Flores, Anthony B Costa, Yindalon Aphinyanaphongs, Kyunghyun Cho, and Eric Karl Oermann. 2023 · 2023
Later among the works it cites.
Publicly shareable clinical large language model built on synthetic clinical notes
Sunjun Kweon, Junu Kim, Jiyoun Kim, Sujeong Im, Eunbyeol Cho, Seongsu Bae, Jungwoo Oh, Gyubok Lee, Jong Hak Moon, Seng Chan You, Seungjin Baek, Chang Hoon Han, Yoon Bin Jung, Yohan Jo, and E. Choi. 2023 · 2023
Later among the works it cites.
Do we still need clinical language models?
Eric P. Lehman, Evan Hernandez, Diwakar Mahajan, Jonas Wulff, Micah J. Smith, Zachary M. Ziegler, Daniel Nadler, Peter Szolovits, Alistair E. W. Johnson, and Emily Alsentzer. 2023 · 2023
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
PLM-ICD: Automatic ICD coding with pretrained language models
Chao-Wei Huang, Shang-Chi Tsai, and Yun-Nung Chen. 2022 · 2022
Cited alongside, same era.
MedJEx: A medical jargon extraction model with Wiki’s hyperlink span and contextualized masked language model score
Sunjae Kwon, Zonghai Yao, Harmon Jordan, David Levy, Brian Corner, and Hong Yu. 2022 · 2022
Cited alongside, same era.
Clinical-longformer and clinical-bigbird: Transformers for long clinical sequences
Yikuan Li, Ramsey M. Wehbe, Faraz S. Ahmad, Hanyin Wang, and Yuan Luo. 2022 · 2022
Cited alongside, same era.
ClinicalT5: A generative language model for clinical text
Qiuhao Lu, Dejing Dou, and Thien Nguyen. 2022 · 2022
Cited alongside, same era.
PromptEHR: Conditional electronic healthcare records generation with prompt learning
Zifeng Wang and Jimeng Sun. 2022 · 2022
Cited alongside, same era.
Knowledge injected prompt based fine-tuning for multi-label few-shot ICD coding
Zhichao Yang, Shufan Wang, Bhanu Pratap Singh Rawat, Avijit Mitra, and Hong Yu. 2022b · 2022
Cited alongside, same era.
Hierarchical bert for medical document understanding
Ning Zhang and Maciej Jankowski. 2022 · 2022
Cited alongside, same era.
Later among the works it cites.
Scaling data-constrained language models
Niklas Muennighoff, Alexander M. Rush, Boaz Barak, Teven Le Scao, Aleksandra Piktus, Nouamane Tazi, Sampo Pyysalo, Thomas Wolf, and Colin Raffel. 2023 · 2023
Later among the works it cites.
Longbox: Evaluating transformers on long-sequence clinical tasks
Mihir Parmar, Aakanksha Naik, Himanshu Gupta, Disha Agrawal, and Chitta Baral. 2023 · 2023
Later among the works it cites.
A study of generative large language model for medical research and healthcare
C.A.I. Peng, Xi Yang, Aokun Chen, Kaleb E. Smith, Nima M. Pournejatian, Anthony B Costa, Cheryl Martin, Mona G. Flores, Ying Zhang, Tanja Magoc, Gloria P. Lipori, Duane A. Mitchell, Naykky Maruquel Singh Ospina, Mustafa Mamon Ahmed, William R. Hogan, Elizabeth A. Shenkman, Yi Guo, Jiang Bian, and Yonghui Wu. 2023 · 2023
Later among the works it cites.
Clinical prompt learning with frozen language models
Niall Taylor, Yi Zhang, Dan W. Joyce, Ziming Gao, Andrey Kormilitzin, and Alejo Nevado-Holgado. 2023 · 2023
Later among the works it cites.
Yuqing Wang, Yun Zhao, and Linda Petzold. 2023 · 2023
Later among the works it cites.
Transformehr: transformer-based encoder-decoder generative model to enhance prediction of disease outcomes using electronic health records
Zhichao Yang, Avijit Mitra, Weisong Liu, Dan Berlowitz, and Hong Yu. 2023 · 2023
Later among the works it cites.
Localtweets to localfealth: A mental health surveillance framework based on twitter data
Vijeta Deshpande, Minhwa Lee, Zonghai Yao, Zihao Zhang, Jason Brian Gibbons, and Hong Yu. 2024 · 2024
Closest in time.
Units: Building a unified time series model
Shanghua Gao, Teddy Koker, Owen Queen, Thomas Hartvigsen, Theodoros Tsiligkaridis, and Marinka Zitnik. 2024 · 2024
Closest in time.
Recent advances in predictive modeling with electronic health records
Jiaqi Wang, Junyu Luo, Muchao Ye, Xiaochen Wang, Yuan Zhong, Aofei Chang, Guanjie Huang, Ziyi Yin, Cao Xiao, Jimeng Sun, and Fenglong Ma. 2024 · 2024
Closest in time.
Zero-shot clinical trial patient matching with llms
Michael Wornow, Alejandro Lozano, Dev Dash, Jenelle A. Jindal, Kenneth W. Mahaffey, and Nigam H. Shah. 2024 · 2024
Closest in time.