Fetching the paper…
Reading the bibliography…
To enhance the performance of large language models (LLMs) in biomedical natural language processing (BioNLP) by introducing a domain-specific instruction dataset and examining its impact when combined with multi-task learning principles.
An overview of the BIOASQ large-scale biomedical semantic indexing and question answering competition
Tsatsaronis G, Balikas G, Malakasiotis P, Partalas I, Zschunke M, Alvers MR, et al · 2015
Earlier work this paper cites.
Clinical information extraction applications: a literature review
Wang Y, Wang L, Rastegar-Mojarad M, Moon S, Shen F, Afzal N, et al · 2018
Earlier work this paper cites.
An Overview of Multi-task Learning
Zhang Y, Yang Q · 2018
Earlier work this paper cites.
The Natural Language Decathlon: Multitask Learning as Question Answering
McCann B, Keskar NS, Xiong C, Socher R · 2018
Earlier work this paper cites.
Publicly available clinical BERT embeddings
Alsentzer E, Murphy JR, Boag W, Weng WH, Jin D, Naumann T, et al · 2019
Earlier work this paper cites.
Transfer learning in biomedical natural language processing: an evaluation of BERT and ELMo on ten benchmarking datasets
Peng Y, Yan S, Lu Z · 2019
Earlier work this paper cites.
Pubmedqa: A dataset for biomedical research question answering
Jin Q, Dhingra B, Liu Z, Cohen WW, Lu X · 2019
Earlier work this paper cites.
Mednli-a natural language inference dataset for the clinical domain
Shivade C, et al · 2019
Earlier work this paper cites.
Fine-Tuning Bidirectional Encoder Representations From Transformers (BERT)–Based Models on Large-Scale Electronic Health Record Notes: An Empirical Study
Li F, Jin Y, Liu W, Rawat BPS, Cai P, Yu H · 2019
Earlier work this paper cites.
Can You Tell Me How to Get Past Sesame Street? Sentence-Level Pretraining Beyond Language Modeling
Wang A, Hula J, Xia P, Pappagari R, McCoy RT, Patel R, et al · 2019
Earlier work this paper cites.
Language Models are Few-Shot Learners
Brown TB, Mann B, Ryder N, Subbiah M, Kaplan J, Dhariwal P, et al · 2020
Earlier work this paper cites.
Generating SOAP notes from doctor-patient conversations using modular summarization techniques
Krishna K, Khosla S, Bigham JP, Lipton ZC · 2020
Earlier work this paper cites.
MedDialog: Large-scale Medical Dialogue Datasets
Zeng G, Yang W, Ju Z, Yang Y, Wang S, Zhang R, et al · 2020
Earlier work this paper cites.
Generating Accurate Electronic Health Assessment from Medical Graph
Yang Z, Yu H · 2020
Earlier work this paper cites.
BioBERT: a pre-trained biomedical language representation model for biomedical text mining
Lee J, Yoon W, Kim S, Kim D, Kim S, So CH, et al · 2020
Earlier work this paper cites.
Intermediate-Task Transfer Learning with Pretrained Language Models: When and Why Does It Work?
Pruksachatkun Y, Phang J, Liu H, Htut PM, Zhang X, Pang RY, et al · 2020
Earlier work this paper cites.
Exploring and Predicting Transferability across NLP Tasks
Vu T, Wang T, Munkhdalai T, Sordoni A, Trischler A, Mattarella-Micke A, et al · 2020
Earlier work this paper cites.
Intrinsic dimensionality explains the effectiveness of language model fine-tuning
Aghajanyan A, Zettlemoyer L, Gupta S · 2020
Earlier work this paper cites.
Multitask Prompted Training Enables Zero-Shot Task Generalization
Sanh V, Webson A, Raffel C, Bach SH, Sutawika L, Alyafeai Z, et al · 2021
Earlier work this paper cites.
Clinical outcome prediction from admission notes using self-supervised knowledge integration
Van Aken B, Papaioannou JM, Mayrdorfer M, Budde K, Gers FA, Loeser A · 2021
Earlier work this paper cites.
Finetuned language models are zero-shot learners; 2021.
Wei J, Bosma M, Zhao VY, Guu K, Yu AW, Lester B, et al · 2021
Earlier work this paper cites.
Med-BERT: pretrained contextualized embeddings on large-scale structured electronic health records for disease prediction
Rasmy L, Xiang Y, Xie Z, Tao C, Zhi D · 2021
Cited alongside, same era.
Generating Datasets with Pretrained Language Models
Schick T, Schütze H · 2021
Cited alongside, same era.
What disease does this patient have? a large-scale open domain question answering dataset from medical exams
Jin D, Pan E, Oufattole N, Weng WH, Fang H, Szolovits P · 2021
Cited alongside, same era.
Prefix-tuning: Optimizing continuous prompts for generation
Li XL, Liang P · 2021
Cited alongside, same era.
Lora: Low-rank adaptation of large language models
Hu EJ, Shen Y, Wallis P, Allen-Zhu Z, Li Y, Wang S, et al · 2021
Cited alongside, same era.
Performance of Multimodal GPT-4V on USMLE with Image: Potential for Imaging Diagnostic Support with Explanations
Yang Z, Yao Z, Tasmin M, Vashisht P, Jang WS, Wang B, et al · 2023
Closest in time.
Do We Still Need Clinical Language Models?
Lehman E, Hernandez E, Mahajan D, Wulff J, Smith MJ, Ziegler Z, et al · 2023
Closest in time.
Llama: Open and efficient foundation language models
Touvron H, Lavril T, Izacard G, Martinet X, Lachaux MA, Lacroix T, et al · 2023
Closest in time.
Touvron H, Martin L, Stone K, Albert P, Almahairi A, Babaei Y, et al.. Llama 2: Open Foundation and Fine-Tuned Chat Models; 2023
2023
Closest in time.
Overview of the MEDIQA-Chat 2023 Shared Tasks on the Summarization & Generation of Doctor-Patient Conversations
Ben Abacha A, Yim Ww, Adams G, Snider N, Yetisgen M · 2023
Closest in time.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Chowdhery A, Narang S, Devlin J, Bosma M, Mishra G, Roberts A, et al · 2022
Cited alongside, same era.
Scaling instruction-finetuned language models
Chung HW, Hou L, Longpre S, Zoph B, Tay Y, Fedus W, et al · 2022
Cited alongside, same era.
Cross-Task Generalization via Natural Language Crowdsourcing Instructions
Mishra S, Khashabi D, Baral C, Hajishirzi H · 2022
Cited alongside, same era.
Super-naturalinstructions: Generalization via declarative instructions on 1600+ nlp tasks
Wang Y, Mishra S, Alipoormolabashi P, Kordi Y, Mirzaei A, Arunkumar A, et al · 2022
Cited alongside, same era.
Training language models to follow instructions with human feedback, 2022
Ouyang L, Wu J, Jiang X, Almeida D, Wainwright CL, Mishkin P, et al · 2022
Cited alongside, same era.
Self-instruct: Aligning language model with self generated instructions
Wang Y, Kordi Y, Mishra S, Liu A, Smith NA, Khashabi D, et al · 2022
Cited alongside, same era.
Biomedical question answering: a survey of approaches and challenges
Jin Q, Yuan Z, Xiong G, Yu Q, Ying H, Tan C, et al · 2022
Cited alongside, same era.
NoteChat: A Dataset of Synthetic Doctor-Patient Conversations Conditioned on Clinical Notes; 2023. Available from: https://api.semanticscholar.org/CorpusID:264439568
Wang J, Yao Z, Yang Z, Zhou H, Li R, Wang X, et al · 2023
Closest in time.
UMASS_BioNLP at MEDIQA-Chat 2023: Can LLMs generate high-quality synthetic note-oriented doctor-patient conversations?
Wang J, Yao Z, Mitra A, Osebe S, Yang Z, Yu H · 2023
Closest in time.
Improving Summarization with Human Edits
Yao Z, Schloss BJ, Selvaraj SP · 2023
Closest in time.
Pmc-llama: Further finetuning llama on medical papers
Wu C, Zhang X, Zhang Y, Wang Y, Xie W · 2023
Closest in time.
Publicly Shareable Clinical Large Language Model Built on Synthetic Clinical Notes
Kweon S, Kim J, Kim J, Im S, Cho E, Bae S, et al · 2023
Closest in time.
MedAlpaca–An Open-Source Collection of Medical Conversational AI Models and Training Data
Han T, Adams LC, Papaioannou JM, Grundmann P, Oberhauser T, Löser A, et al · 2023
Closest in time.
Chatdoctor: A medical chat model fine-tuned on llama model using medical domain knowledge
Yunxiang L, Zihan L, Kai Z, Ruilong D, You Z · 2023
Closest in time.
Tuning language models as training data generators for augmentation-enhanced few-shot learning
Meng Y, Michalski M, Huang J, Zhang Y, Abdelzaher T, Han J · 2023
Closest in time.
AlpaCare: Instruction-tuned Large Language Models for Medical Application
Zhang X, Tian C, Yang X, Chen L, Li Z, Petzold LR · 2023
Closest in time.
Stanford alpaca: an instruction-following llama model (2023)
Taori R, Gulrajani I, Zhang T, Dubois Y, Li X, Guestrin C, et al · 2023
Closest in time.
Gptscore: Evaluate as you desire
Fu J, Ng SK, Jiang Z, Liu P · 2023
Closest in time.
G-eval: Nlg evaluation using gpt-4 with better human alignment, may 2023
Liu Y, Iter D, Xu Y, Wang S, Xu R, Zhu C · 2023
Closest in time.
Huatuogpt, towards taming language model to be a doctor
Zhang H, Chen J, Jiang F, Yu F, Chen Z, Li J, et al · 2023
Closest in time.
TaskWeb: Selecting Better Source Tasks for Multi-task NLP
Kim J, Asai A, Ilharco G, Hajishirzi H · 2023
Closest in time.
GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints
Ainslie J, Lee-Thorp J, de Jong M, Zemlyanskiy Y, Lebrón F, Sanghai S · 2023
Closest in time.