Fetching the paper…
Reading the bibliography…
Many large language models (LLMs) for medicine have largely been evaluated on short texts, and their ability to handle longer sequences such as a complete electronic health record (EHR) has not been systematically explored.
Documentation of mandated discharge summary components in transitions from acute to subacute care
Amy JH Kind and Maureen A Smith. 2008 · 2008
Earlier work this paper cites.
Identifying patient smoking status from medical discharge records
Özlem Uzuner, Ira Goldstein, Yuan Luo, and Isaac Kohane. 2008 · 2008
Earlier work this paper cites.
Recognizing obesity and comorbidities in sparse data
Özlem Uzuner. 2009 · 2009
Earlier work this paper cites.
2010 i2b2/va challenge on concepts, assertions, and relations in clinical text
Özlem Uzuner, Brett R South, Shuying Shen, and Scott L DuVall. 2011 · 2010
Earlier work this paper cites.
Evaluating temporal relations in clinical text: 2012 i2b2 challenge
Weiyi Sun, Anna Rumshisky, and Ozlem Uzuner. 2013 · 2012
Earlier work this paper cites.
Creation of a new longitudinal corpus of clinical narratives
Vishesh Kumar, Amber Stubbs, Stanley Shaw, and Özlem Uzuner. 2015 · 2015
Earlier work this paper cites.
2018 n2c2 shared task on adverse drug events and medication extraction in electronic health records
Sam Henry, Kevin Buchan, Michele Filannino, Amber Stubbs, and Ozlem Uzuner. 2020 · 2018
Earlier work this paper cites.
Cohort selection for clinical trials: n2c2 2018 shared task track 1
Amber Stubbs, Michele Filannino, Ergin Soysal, Samuel Henry, and Özlem Uzuner. 2019 · 2018
Earlier work this paper cites.
Pretrained language models for biomedical and clinical tasks: Understanding and extending the state-of-the-art
Patrick Lewis, Myle Ott, Jingfei Du, and Veselin Stoyanov. 2020 · 2020
Earlier work this paper cites.
Exploring the limits of transfer learning with a unified text-to-text transformer
Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J Liu. 2020 · 2020
Earlier work this paper cites.
A practical survey on faster and lighter transformers
Quentin Fournier, Gaétan Marceau Caron, and Daniel Aloise. 2021 · 2021
Cited alongside, same era.
Leveraging passage retrieval with generative models for open domain question answering
Gautier Izacard and Edouard Grave. 2021 · 2021
Cited alongside, same era.
Scifive: a text-to-text transformer model for biomedical literature
Long N Phan, James T Anibal, Hieu Tran, Shaurya Chanana, Erol Bahadroglu, Alec Peltekian, and Grégoire Altan-Bonnet. 2021 · 2021
Cited alongside, same era.
Yuqi Si and Kirk Roberts. 2021 · 2021
Cited alongside, same era.
Long range arena: A benchmark for efficient transformers
Yi Tay, Mostafa Dehghani, Samira Abnar, Yikang Shen, Dara Bahri, Philip Pham, Jinfeng Rao, Liu Yang, Sebastian Ruder, and Donald Metzler. 2021 · 2021
ClinicalT5: A generative language model for clinical text
Qiuhao Lu, Dejing Dou, and Thien Nguyen. 2022 · 2022
Later among the works it cites.
Biogpt: generative pre-trained transformer for biomedical text generation and mining
Renqian Luo, Liai Sun, Yingce Xia, Tao Qin, Sheng Zhang, Hoifung Poon, and Tie-Yan Liu. 2022 · 2022
Later among the works it cites.
In-BoXBART: Get instructions into biomedical multi-task learning
Mihir Parmar, Swaroop Mishra, Mirali Purohit, Man Luo, Murad Mohammad, and Chitta Baral. 2022 · 2022
Later among the works it cites.
SCROLLS: Standardized CompaRison over long language sequences
Uri Shaham, Elad Segal, Maor Ivgi, Avia Efrat, Ori Yoran, Adi Haviv, Ankit Gupta, Wenhan Xiong, Mor Geva, Jonathan Berant, and Omer Levy. 2022 · 2022
Later among the works it cites.
Large language models encode clinical knowledge
Karan Singhal, Shekoofeh Azizi, Tao Tu, S Sara Mahdavi, Jason Wei, Hyung Won Chung, Nathan Scales, Ajay Tanwani, Heather Cole-Lewis, Stephen Pfohl, et al. 2022 · 2022
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
GPT-NeoX-20B: An open-source autoregressive language model
Sidney Black, Stella Biderman, Eric Hallahan, Quentin Anthony, Leo Gao, Laurence Golding, Horace He, Connor Leahy, Kyle McDonell, Jason Phang, Michael Pieler, Usvsn Sai Prashanth, Shivanshu Purohit, Laria Reynolds, Jonathan Tow, Ben Wang, and Samuel Weinbach. 2022 · 2022
Cited alongside, same era.
How long is enough? exploring the optimal intervals of long-range clinical note language modeling
Samuel Cahyawijaya, Bryan Wilie, Holy Lovenia, Huan Zhong, MingQian Zhong, Yuk-Yu Nancy Ip, and Pascale Fung. 2022 · 2022
Cited alongside, same era.
Scaling instruction-finetuned language models
Hyung Won Chung, Le Hou, Shayne Longpre, Barret Zoph, Yi Tay, William Fedus, Eric Li, Xuezhi Wang, Mostafa Dehghani, Siddhartha Brahma, et al. 2022 · 2022
Cited alongside, same era.
LongT5: Efficient text-to-text transformer for long sequences
Mandy Guo, Joshua Ainslie, David Uthus, Santiago Ontanon, Jianmo Ni, Yun-Hsuan Sung, and Yinfei Yang. 2022 · 2022
Cited alongside, same era.
Clinical-longformer and clinical-bigbird: Transformers for long clinical sequences
Yikuan Li, Ramsey M Wehbe, Faraz S Ahmad, Hanyin Wang, and Yuan Luo. 2022 · 2022
Cited alongside, same era.
Efficient transformers: A survey
Yi Tay, Mostafa Dehghani, Dara Bahri, and Donald Metzler. 2022 · 2022
Later among the works it cites.
Biomedlm: a domain-specific large language model for biomedical text
A Venigalla, J Frankle, and M Carbin. 2022 · 2022
Later among the works it cites.
A survey on long text modeling with transformers
Zican Dong, Tianyi Tang, Lunyi Li, and Wayne Xin Zhao. 2023 · 2023
Closest in time.
A study of generative large language model for medical research and healthcare
Cheng Peng, Xi Yang, Aokun Chen, Kaleb E Smith, Nima PourNejatian, Anthony B Costa, Cheryl Martin, Mona G Flores, Ying Zhang, Tanja Magoc, et al. 2023 · 2023
Closest in time.
Llama 2: Open foundation and fine-tuned chat models
Hugo Touvron, Louis Martin, Kevin Stone, Peter Albert, Amjad Almahairi, Yasmine Babaei, Nikolay Bashlykov, Soumya Batra, Prajjwal Bhargava, Shruti Bhosale, et al. 2023 · 2023
Closest in time.