Self-supervised Image-text Pre-training With Mixed Data In Chest X-rays

Understand

Pre-trained models, e.g., from ImageNet, have proven to be effective in boosting the performance of many downstream applications.

• It is too demanding to acquire large-scale annotations to build such models for medical imaging.
• Meanwhile, there are numerous clinical data (in the form of images and text reports) stored in the hospital information systems.
• The paired image-text data from the same patient study could be utilized for the pre-training task in a weakly supervised manner.