Prompt Engineering for Healthcare: Methodologies and Applications

R. Baud, A.-M. Rassinoux, and J.-R. Scherrer, “Natural language processing and semantical representation of medical texts,” Methods of information in medicine , vol. 31, no. 02, pp. 117–125, 1992

1992

Earlier work this paper cites.

J. Zhou, Q. Zhang, Q. Chen, L. He, and X.-J. Huang, “A multi-format transfer learning model for event argument extraction via variational information bottleneck,” in Proceedings of the 29th International Conference on Computational Linguistics , 2022, pp. 1990–2000

2000

Earlier work this paper cites.

J. Kopač, M. Bahor, and M. Soković, “Optimal machining parameters for achieving the desired surface roughness in fine turning of cold pre-formed steel workpieces,” International Journal of Machine Tools and Manufacture , vol. 42, no. 6, pp. 707–716, 2002

2002

Earlier work this paper cites.

L. Zhou and G. Hripcsak, “Temporal reasoning with medical data—a review with emphasis on medical natural language processing,” Journal of biomedical informatics , vol. 40, no. 2, pp. 183–202, 2007

2007

Earlier work this paper cites.

W. B. Knox and P. Stone, “Interactively shaping agents via human reinforcement: The tamer framework,” in Proceedings of the fifth international conference on Knowledge capture , 2009, pp. 9–16

2009

Earlier work this paper cites.

A. Azaria, A. Ekblaw, T. Vieira, and A. Lippman, “Medrec: Using blockchain for medical data access and permission management,” in 2016 2nd international conference on open and big data (OBD) . IEEE, 2016, pp. 25–30

2016

Earlier work this paper cites.

P. J. Liu, M. Saleh, E. Pot, B. Goodrich, R. Sepassi, L. Kaiser, and N. Shazeer, “Generating wikipedia by summarizing long sequences,” in International Conference on Learning Representations , 2018

2018

Earlier work this paper cites.

A. Romanov and C. Shivade, “Lessons from natural language inference in the clinical domain,” in Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing , 2018, pp. 1586–1596

2018

Earlier work this paper cites.

V. François-Lavet, P. Henderson, R. Islam, M. G. Bellemare, J. Pineau et al. , “An introduction to deep reinforcement learning,” Foundations and Trends® in Machine Learning , vol. 11, no. 3-4, pp. 219–354, 2018

2018

Earlier work this paper cites.

F. Petroni, T. Rocktäschel, S. Riedel, P. Lewis, A. Bakhtin, Y. Wu, and A. Miller, “Language models as knowledge bases?” in Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) , 2019, pp. 2463–2473

2019

Earlier work this paper cites.

E. Wallace, S. Feng, N. Kandpal, M. Gardner, and S. Singh, “Universal adversarial triggers for attacking and analyzing nlp,” in Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) , 2019

2019

Earlier work this paper cites.

J. D. M.-W. C. Kenton and L. K. Toutanova, “Bert: Pre-training of deep bidirectional transformers for language understanding,” in Proceedings of NAACL-HLT , 2019, pp. 4171–4186

2019

Earlier work this paper cites.

A. Radford, J. Wu, R. Child, D. Luan, D. Amodei, I. Sutskever et al. , “Language models are unsupervised multitask learners,” OpenAI blog , vol. 1, no. 8, p. 9, 2019

2019

Earlier work this paper cites.

C. Raffel, N. Shazeer, A. Roberts, K. Lee, S. Narang, M. Matena, Y. Zhou, W. Li, and P. J. Liu, “Exploring the limits of transfer learning with a unified text-to-text transformer,” The Journal of Machine Learning Research , vol. 21, no. 1, pp. 5485–5551, 2020

2020

Earlier work this paper cites.

X. Qiu, T. Sun, Y. Xu, Y. Shao, N. Dai, and X. Huang, “Pre-trained models for natural language processing: A survey,” Science China Technological Sciences , vol. 63, no. 10, pp. 1872–1897, 2020

2020

Earlier work this paper cites.

G. Rong, A. Mendez, E. B. Assi, B. Zhao, and M. Sawan, “Artificial intelligence in healthcare: review and prediction case studies,” Engineering , vol. 6, no. 3, pp. 291–301, 2020

2020

Earlier work this paper cites.

T. Shin, Y. Razeghi, R. L. Logan IV, E. Wallace, and S. Singh, “Autoprompt: Eliciting knowledge from language models with automatically generated prompts,” in Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) , 2020, pp. 4222–4235

2020

Earlier work this paper cites.

T. Brown, B. Mann, N. Ryder, M. Subbiah, J. D. Kaplan, P. Dhariwal, A. Neelakantan, P. Shyam, G. Sastry, A. Askell et al. , “Language models are few-shot learners,” Advances in neural information processing systems , vol. 33, pp. 1877–1901, 2020

2020

Earlier work this paper cites.

J. DeYoung, E. Lehman, B. Nye, I. Marshall, and B. C. Wallace, “Evidence inference 2.0: More data, better models,” in Proceedings of the 19th SIGBioMed Workshop on Biomedical Language Processing , 2020, pp. 123–132

2020

Earlier work this paper cites.

Y. Du, S. Oraby, V. Perera, M. Shen, A. Narayan-Chen, T. Chung, A. Venkatesh, and D. Hakkani-Tur, “Schema-guided natural language generation,” in Proceedings of the 13th International Conference on Natural Language Generation , 2020, pp. 283–295

2020

Earlier work this paper cites.

T.-H. Lo, S.-Y. Weng, H.-J. Chang, and B. Chen, “An effective end-to-end modeling approach for mispronunciation detection,” arXiv preprint arXiv:2005.08440 , 2020

Original

2020

Earlier work this paper cites.

K. McGuffie and A. Newhouse, “The radicalization risks of gpt-3 and advanced neural language models,” arXiv preprint arXiv:2009.06807 , 2020

Original

2020

Earlier work this paper cites.

B. Lester, R. Al-Rfou, and N. Constant, “The power of scale for parameter-efficient prompt tuning,” arXiv preprint arXiv:2104.08691 , 2021

Original

2021

Earlier work this paper cites.

X. L. Li and P. Liang, “Prefix-tuning: Optimizing continuous prompts for generation,” in Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) , 2021, pp. 4582–4597

2021

Earlier work this paper cites.

A. Najar and M. Chetouani, “Reinforcement learning with human advice: a survey,” Frontiers in Robotics and AI , vol. 8, p. 584075, 2021

2021

Earlier work this paper cites.

L. Cui, Y. Wu, J. Liu, S. Yang, and Y. Zhang, “Template-based named entity recognition using bart,” in Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021 , 2021, pp. 1835–1845

2021

Earlier work this paper cites.

T. Gao, A. Fisch, and D. Chen, “Making pre-trained language models better few-shot learners,” in Joint Conference of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, ACL-IJCNLP 2021 . Association for Computational Linguistics (ACL), 2021, pp. 3816–3830

2021

Earlier work this paper cites.

S. Min, M. Lewis, H. Hajishirzi, and L. Zettlemoyer, “Noisy channel language model prompting for few-shot text classification,” arXiv preprint arXiv:2108.04106 , 2021

Original

2021

Earlier work this paper cites.

M. Sung, J. Lee, S. Yi, M. Jeon, S. Kim, and J. Kang, “Can language models be biomedical knowledge bases?” in Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing , 2021, pp. 4723–4734

2021

Earlier work this paper cites.

N. Ding, S. Hu, W. Zhao, Y. Chen, Z. Liu, H. Zheng, and M. Sun, “Openprompt: An open-source framework for prompt-learning,” in Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics: System Demonstrations , 2022, pp. 105–113

2022

Earlier work this paper cites.

V. Liu and L. B. Chilton, “Design guidelines for prompt engineering text-to-image generative models,” in Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems , 2022, pp. 1–23

2022

Earlier work this paper cites.

T. Sorensen, J. Robinson, C. Rytting, A. Shaw, K. Rogers, A. Delorey, M. Khalil, N. Fulda, and D. Wingate, “An information-theoretic approach to prompt engineering without ground truth labels,” in Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) , 2022, pp. 819–862

2022

Earlier work this paper cites.

K. Zhou, J. Yang, C. C. Loy, and Z. Liu, “Learning to prompt for vision-language models,” International Journal of Computer Vision , vol. 130, no. 9, pp. 2337–2348, 2022

2022

Earlier work this paper cites.

K. He, X. Chen, S. Xie, Y. Li, P. Dollár, and R. Girshick, “Masked autoencoders are scalable vision learners,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , 2022, pp. 16 000–16 009

2022

Earlier work this paper cites.

S. Sivarajkumar and Y. Wang, “Healthprompt: A zero-shot learning paradigm for clinical natural language processing,” arXiv preprint arXiv:2203.05061 , 2022

Original

2022

Earlier work this paper cites.

W. Feng, X. Bu, C. Zhang, and X. Li, “Beyond bounding box: Multimodal knowledge learning for object detection,” arXiv preprint arXiv:2205.04072 , 2022

Original

2022

Earlier work this paper cites.

S. Liang, M. Zhao, and H. Schütze, “Modular and parameter-efficient multimodal fusion with prompting,” arXiv preprint arXiv:2203.08055 , 2022

Original

2022

Earlier work this paper cites.

M. Abaho, D. Bollegala, P. Williamson, and S. Dodd, “Position-based prompting for health outcome generation,” in Proc. of The 21st BioNLP workshop associated with the ACL SIGBIOMED special interest group , 2022

2022

Earlier work this paper cites.

Y. Zhou, A. I. Muresanu, Z. Han, K. Paster, S. Pitis, H. Chan, and J. Ba, “Large language models are human-level prompt engineers,” arXiv preprint arXiv:2211.01910 , 2022

Original

2022

Earlier work this paper cites.

Y. Wang, J. Deng, T. Wang, B. Zheng, S. Hu, X. Liu, and H. Meng, “Exploiting prompt learning with pre-trained language models for alzheimer’s disease detection,” arXiv preprint arXiv:2210.16539 , 2022

Original

2022

Earlier work this paper cites.

H. Wang, C. Liu, N. Xi, S. Zhao, M. Ju, S. Zhang, Z. Zhang, Y. Zheng, B. Qin, and T. Liu, “Prompt combines paraphrase: Teaching pre-trained models to understand rare biomedical words,” in Proceedings of the 29th International Conference on Computational Linguistics , 2022, pp. 1422–1431

2022

Earlier work this paper cites.

T. Chen, L. Liu, X. Jia, B. Cui, H. Tang, and S. Tang, “Distilling task-specific logical rules from large pre-trained models,” arXiv preprint arXiv:2210.02768 , 2022

Original

2022

Earlier work this paper cites.

Y. Wang, W. Huang, C. Li, X. Zheng, Y. Lin, and S. Wang, “Adaptive promptnet for auxiliary glioma diagnosis without contrast-enhanced mri,” arXiv preprint arXiv:2211.07966 , 2022

Original

2022

Earlier work this paper cites.

P. Chambon, C. Bluethgen, C. P. Langlotz, and A. Chaudhari, “Adapting pretrained vision-language foundational models to medical imaging domains,” arXiv preprint arXiv:2210.04133 , 2022

Original

2022

Earlier work this paper cites.

E. Lehman, V. Lialin, K. Y. Legaspi, A. J. R. Sy, P. T. S. Pile, N. R. I. Alberto, R. R. R. Ragasa, C. V. M. Puyat, I. R. I. Alberto, P. G. I. Alfonso et al. , “Learning to ask like a physician,” arXiv preprint arXiv:2206.02696 , 2022

Original

2022

Earlier work this paper cites.

Z. Qin, H. Yi, Q. Lao, and K. Li, “Medical image understanding with pretrained vision language models: A comprehensive study,” arXiv preprint arXiv:2209.15517 , 2022

Original

2022

Earlier work this paper cites.

K. Singhal, S. Azizi, T. Tu, S. S. Mahdavi, J. Wei, H. W. Chung, N. Scales, A. Tanwani, H. Cole-Lewis, S. Pfohl et al. , “Large language models encode clinical knowledge,” arXiv preprint arXiv:2212.13138 , 2022

Original

2022

Cited alongside, same era.

B. Li, Y. Weng, B. Sun, and S. Li, “Towards visual-prompt temporal answering grounding in medical instructional video,” arXiv preprint arXiv:2203.06667 , 2022

Original

2022

Cited alongside, same era.

K. Kolluru, G. Stanovsky et al. , ““covid vaccine is against covid but oxford vaccine is made at oxford!” semantic interpretation of proper noun compounds,” in Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing , 2022, pp. 10 407–10 420

2022

Cited alongside, same era.

N. Taylor, Y. Zhang, D. Joyce, A. Nevado-Holgado, and A. Kormilitzin, “Clinical prompt learning with frozen language models,” arXiv preprint arXiv:2205.05535 , 2022

Original

2022

Cited alongside, same era.

L. Milecki, V. Kalogeiton, S. Bodard, D. Anglicheau, J.-M. Correas, M.-O. Timsit, and M. Vakalopoulou, “Medimp: Medical images and prompts for renal transplant representation learning,” in MIDL 2023 , 2023

2023

Closest in time.

C. Yang, A. Woicik, H. Poon, and S. Wang, “Bliam: Literature-based data synthesis for synergistic drug combination prediction,” arXiv preprint arXiv:2302.06860 , 2023

Original

2023

Closest in time.

Z. Gao, Y. Hu, C. Tan, and S. Z. Li, “Prefixmol: Target-and chemistry-aware molecule design via prefix embedding,” arXiv preprint arXiv:2302.07120 , 2023

Original

2023

Closest in time.

V. D. Lai, N. T. Ngo, A. P. B. Veyseh, H. Man, F. Dernoncourt, T. Bui, and T. H. Nguyen, “Chatgpt beyond english: Towards a comprehensive evaluation of large language models in multilingual learning,” arXiv preprint arXiv:2304.05613 , 2023

Original

2023

Closest in time.