Advancing Medical Imaging with Language Models: A Journey from N-grams to ChatGPT

Understand

In this paper, we aimed to provide a review and tutorial for researchers in the field of medical imaging using language models to improve their tasks at hand.

• We began by providing an overview of the history and concepts of language models, with a special focus on large language models.
• We then reviewed the current literature on how language models are being used to improve medical imaging, emphasizing different applications such as image captioning, report generation, report classification, finding extraction, visual question answering, interpretable diagnosis, and more for various modalities and organs.
• The ChatGPT was specially highlighted for researchers to explore more potential applications.