医学影像模型依赖无关区域做判断,真实场景下可能失效。
Mask of truth: model sensitivity to unexpected regions of medical images
- 用遮挡法测试模型对关键区域的依赖性
- 即使遮挡病灶区,模型仍保持高判别性能
- 揭示了模型存在非临床相关性捷径,适合临床医生与算法研究者参考
大型医学图像分析模型虽提升性能,却削弱了决策可解释性。模型可能利用图像中非相关区域(即虚假关联或捷径)在基准数据集上取得高分,但在真实场景中表现不佳。本文通过遮挡胸部X光和眼底图像中的临床关注区域,评估卷积神经网络(CNN)的分类能力。结果显示,所有在PadChest数据集上训练的模型,无论遮挡策略如何,其曲线下面积(AUC)均高于随机水平;甚至在去除兴趣区域(ROI)后,模型性能仍优于仅含ROI的图像。此外,在Chaksu数据集中发现潜在虚假关联,而模型表现更符合无偏期望。结合SHAP可解释性方法与嵌入分析,并邀请放射科住院医师参与解读不同遮挡条件下的图像,以融合临床知识。代码已公开于https://github.com/TheoSourget/MMC_Masking 和 https://github.com/TheoSourget/MMC_Masking_EyeFundus。
原文摘要 · Abstract (English)
The development of larger models for medical image analysis has led to increased performance. However, it also affected our ability to explain and validate model decisions. Models can use non-relevant parts of images, also called spurious correlations or shortcuts, to obtain high performance on benchmark datasets but fail in real-world scenarios. In this work, we challenge the capacity of convolutional neural networks (CNN) to classify chest X-rays and eye fundus images while masking out clinically relevant parts of the image. We show that all models trained on the PadChest dataset, irrespective of the masking strategy, are able to obtain an Area Under the Curve (AUC) above random. Moreover, the models trained on full images obtain good performance on images without the region of interest (ROI), even superior to the one obtained on images only containing the ROI. We also reveal a possible spurious correlation in the Chaksu dataset while the performances are more aligned with the expectation of an unbiased model. We go beyond the performance analysis with the usage of the explainability method SHAP and the analysis of embeddings. We asked a radiology resident to interpret chest X-rays under different masking to complement our findings with clinical knowledge. Our code is available at https://github.com/TheoSourget/MMC_Masking and https://github.com/TheoSourget/MMC_Masking_EyeFundus
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。