Fetching the paper…
Reading the bibliography…
We present Clinical Prediction with Large Language Models (CPLLM), a method that involves fine-tuning a pre-trained Large Language Model (LLM) for clinical disease and readmission prediction.
Clinical prediction rules: applications and methodological standards
John H Wasson, Harold C Sox, Raymond K Neff, and Lee Goldman · 1985
Earlier work this paper cites.
Clinical prediction rules: a review and suggested modifications of methodological standards
Andreas Laupacis, Nandita Sekar, et al · 1997
Earlier work this paper cites.
Random forests
Leo Breiman · 2001
Earlier work this paper cites.
Early stopping-but when?
Lutz Prechelt · 2002
Earlier work this paper cites.
The relationship between precision-recall and roc curves
Jesse Davis and Mark Goadrich · 2006
Earlier work this paper cites.
Clinical classifications software (ccs) 2009
Anne Elixhauser · 2009
Earlier work this paper cites.
Anatomical therapeutic chemical classification system (atc)
Gerhard Nahler and Gerhard Nahler · 2009
Earlier work this paper cites.
Scikit-learn: Machine learning in python
Fabian Pedregosa, Gaël Varoquaux, Alexandre Gramfort, Vincent Michel, Bertrand Thirion, Olivier Grisel, Mathieu Blondel, Peter Prettenhofer, Ron Weiss, Vincent Dubourg, et al · 2011
Earlier work this paper cites.
Applied logistic regression , volume 398
David W Hosmer Jr, Stanley Lemeshow, and Rodney X Sturdivant · 2013
Earlier work this paper cites.
Ready or not! here comes icd-10
Laxmaiah Manchikanti, Frank JE Falco, and Joshua A Hirsch · 2013
Earlier work this paper cites.
Clinical classifications software (ccs)
Anne Elixhauser, Claudia Steiner, and L Palmer · 2014
Earlier work this paper cites.
TensorFlow: Large-scale machine learning on heterogeneous systems, 2015
Martín Abadi, Ashish Agarwal, Paul Barham, Eugene Brevdo, Zhifeng Chen, Craig Citro, Greg S. Corrado, Andy Davis, Jeffrey Dean, Matthieu Devin, Sanjay Ghemawat, Ian Goodfellow, Andrew Harp, Geoffrey Irving, Michael Isard, Yangqing Jia, Rafal Jozefowicz, Lukasz Kaiser, Manjunath Kudlur, Josh Levenberg, Dandelion Mané, Rajat Monga, Sherry Moore, Derek Murray, Chris Olah, Mike Schuster, Jonathon Shlens, Benoit Steiner, Ilya Sutskever, Kunal Talwar, Paul Tucker, Vincent Vanhoucke, Vijay Vasudevan, Fernanda Viégas, Oriol Vinyals, Pete Warden, Martin Wattenberg, Martin Wicke, Yuan Yu, and Xiaoqiang Zheng · 2015
Earlier work this paper cites.
Retain: An interpretable predictive model for healthcare using reverse time attention mechanism
Edward Choi, Mohammad Taha Bahadori, Jimeng Sun, Joshua Kulas, Andy Schuetz, and Walter Stewart · 2016
Earlier work this paper cites.
Deepr: a convolutional net for medical records
Phuoc Nguyen, Truyen Tran, Nilmini Wickramasinghe, and Svetha Venkatesh · 2016
Earlier work this paper cites.
Attention is all you need
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin · 2017
Earlier work this paper cites.
Bert: Pre-training of deep bidirectional transformers for language understanding
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova · 2018
Earlier work this paper cites.
Health data analytics using scalable logistic regression with stochastic gradient descent
Gunasekaran Manogaran and Daphne Lopez · 2018
Earlier work this paper cites.
The eicu collaborative research database, a freely available multi-center database for critical care research
Tom J Pollard, Alistair EW Johnson, Jesse D Raffa, Leo A Celi, Roger G Mark, and Omar Badawi · 2018
Cited alongside, same era.
Parameter-efficient transfer learning for nlp
Neil Houlsby, Andrei Giurgiu, Stanislaw Jastrzebski, Bruna Morrone, Quentin De Laroussilhe, Andrea Gesmundo, Mona Attariyan, and Sylvain Gelly · 2019
Cited alongside, same era.
Roberta: A robustly optimized bert pretraining approach
Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov · 2019
Cited alongside, same era.
Huggingface’s transformers: State-of-the-art natural language processing
Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pierric Cistac, Tim Rault, Rémi Louf, Morgan Funtowicz, et al · 2019
Cited alongside, same era.
Gpt-3: Its nature, scope, limits, and consequences
Healthprompt: A zero-shot learning paradigm for clinical natural language processing
Sonish Sivarajkumar and Yanshan Wang · 2022
Later among the works it cites.
Biomedlm: a domain-specific large language model for biomedical text
A Venigalla, J Frankle, and M Carbin · 2022
Later among the works it cites.
A large language model for electronic health records
Xi Yang, Aokun Chen, Nima PourNejatian, Hoo Chang Shin, Kaleb E Smith, Christopher Parisien, Colin Compas, Cheryl Martin, Anthony B Costa, Mona G Flores, et al · 2022
Later among the works it cites.
Falcon-40b: an open large language model with state-of-the-art performance
Ebtesam Almazrouei, Hamza Alobeidli, Abdulaziz Alshamsi, Alessandro Cappelli, Ruxandra Cojocaru, Merouane Debbah, Etienne Goffinet, Daniel Heslow, Julien Launay, Quentin Malartic, et al · 2023
Closest in time.
Boosting transformers and language models for clinical prediction in immunotherapy
Zekai Chen, Mariann Micsinai Balan, and Kevin Brown · 2023
Closest in time.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Luciano Floridi and Massimo Chiriatti · 2020
Cited alongside, same era.
Deberta: Decoding-enhanced bert with disentangled attention
Pengcheng He, Xiaodong Liu, Jianfeng Gao, and Weizhu Chen · 2020
Cited alongside, same era.
Mimic-iv
Alistair Johnson, Lucas Bulgarelli, Tom Pollard, Steven Horng, Leo Anthony Celi, and Roger Mark · 2020
Cited alongside, same era.
Behrt: transformer for electronic health records
Yikuan Li, Shishir Rao, José Roberto Ayala Solares, Abdelaali Hassaine, Rema Ramakrishnan, Dexter Canoy, Yajie Zhu, Kazem Rahimi, and Gholamreza Salimi-Khorshidi · 2020
Cited alongside, same era.
Concare: Personalized clinical feature embedding via capturing the healthcare context
Liantao Ma, Chaohe Zhang, Yasha Wang, Wenjie Ruan, Jiangtao Wang, Wen Tang, Xinyu Ma, Xin Gao, and Junyi Gao · 2020
Cited alongside, same era.
Bidirectional representation learning from transformers using multimodal electronic health record data to predict depression
Yiwen Meng, William Speier, Michael K Ong, and Corey W Arnold · 2021
Cited alongside, same era.
Med-bert: pretrained contextualized embeddings on large-scale structured electronic health records for disease prediction
Laila Rasmy, Yang Xiang, Ziqian Xie, Cui Tao, and Degui Zhi · 2021
Cited alongside, same era.
Language models are an effective representation learning technique for electronic health record data
Ethan Steinberg, Ken Jung, Jason A Fries, Conor K Corbin, Stephen R Pfohl, and Nigam H Shah · 2021
Cited alongside, same era.
Tim Dettmers, Artidoro Pagnoni, Ari Holtzman, and Luke Zettlemoyer · 2023
Closest in time.
Patient event sequences for predicting hospitalization length of stay
Emil Riis Hansen, Thomas Dyhre Nielsen, Thomas Mulvad, Mads Nibe Strausholm, Tomer Sagi, and Katja Hose · 2023
Closest in time.
Health system-scale language models are all-purpose prediction engines
Lavender Yao Jiang, Xujin Chris Liu, Nima Pour Nejatian, Mustafa Nasir-Moin, Duo Wang, Anas Abidin, Kevin Eaton, Howard Antony Riina, Ilya Laufer, Paawan Punjabi, et al · 2023
Closest in time.
Augmented language models: a survey
Grégoire Mialon, Roberto Dessì, Maria Lomeli, Christoforos Nalmpantis, Ramakanth Pasunuru, Roberta Raileanu, Baptiste Rozière, Timo Schick, Jane Dwivedi-Yu, Asli Celikyilmaz, Edouard Grave, Yann LeCun, and Thomas Scialom · 2023
Closest in time.
OpenAI · 2023
Closest in time.
Federated learning of medical concepts embedding using behrt
Ofir Ben Shoham and Nadav Rappoport · 2023
Closest in time.
Large language models encode clinical knowledge
Karan Singhal, Shekoofeh Azizi, Tao Tu, S Sara Mahdavi, Jason Wei, Hyung Won Chung, Nathan Scales, Ajay Tanwani, Heather Cole-Lewis, Stephen Pfohl, et al · 2023
Closest in time.
Text classification via large language models
Xiaofei Sun, Xiaoya Li, Jiwei Li, Fei Wu, Shangwei Guo, Tianwei Zhang, and Guoyin Wang · 2023
Closest in time.
Large language models in medicine
Arun James Thirunavukarasu, Darren Shu Jeng Ting, Kabilan Elangovan, Laura Gutierrez, Ting Fang Tan, and Daniel Shu Wei Ting · 2023
Closest in time.
PyHealth: A deep learning toolkit for healthcare predictive modeling
Chaoqi Yang, Zhenbang Wu, Patrick Jiang, Zhen Lin, Junyi Gao, Benjamin Danek, and Jimeng Sun · 2023
Closest in time.
A survey of large language models
Wayne Xin Zhao, Kun Zhou, Junyi Li, Tianyi Tang, Xiaolei Wang, Yupeng Hou, Yingqian Min, Beichen Zhang, Junjie Zhang, Zican Dong, et al · 2023
Closest in time.
Almanac—retrieval-augmented language models for clinical medicine
Cyril Zakka, Rohan Shad, Akash Chaurasia, Alex R Dalal, Jennifer L Kim, Michael Moor, Robyn Fong, Curran Phillips, Kevin Alexander, Euan Ashley, et al · 2024
Closest in time.