A ChatGPT Aided Explainable Framework for Zero-Shot Medical Image Diagnosis

Understand

Zero-shot medical image classification is a critical process in real-world scenarios where we have limited access to all possible diseases or large-scale annotated data.

• It involves computing similarity scores between a query medical image and possible disease categories to determine the diagnostic result.
• Recent advances in pretrained vision-language models (VLMs) such as CLIP have shown great performance for zero-shot natural image recognition and exhibit benefits in medical applications.
• However, an explainable zero-shot medical image recognition framework with promising performance is yet under development.