arXiv:2502.17824cs.CVcs.LG2025-02被引 1

用弱监督方法实现精准可解释的像素级医学图像标注。

Weakly Supervised Pixel-Level Annotation with Visual Interpretability

  • 集成三个模型并结合可视化与不确定性分析,模拟多位医生共识。
  • 仅用图像级标签训练,仍达TBX11K上93.04%准确率和64.7% IoU。
  • 结果可解释且关键错误自动标记,适合医疗诊断辅助场景。

医学图像标注对疾病诊断至关重要,但人工标注耗时费力且存在专家间差异。为解决此问题,我们提出一种自动化可解释标注系统,融合集成学习、视觉可解释性与不确定性量化。该方法结合ResNet50、EfficientNet和DenseNet三个预训练模型,通过XGrad-CAM生成视觉解释,并利用Monte Carlo Dropout量化不确定性。系统通过交集一致的显著图模拟多位放射科医生的共识,对不确定预测标记供人工复核。在TBX11K医学影像数据集与火灾分割数据集上的评估表明,该方法在不同领域均具鲁棒性。实验结果显示,其在TBX11K上达到93.04%准确率,在火灾数据集上达96.4%;尽管仅使用图像级标签训练,仍实现36.07%和64.7%的交并比(IoU)像素级标注精度。该方法提升了标注的准确性与透明度,为医学诊断及其他图像分析任务提供可靠、可解释的解决方案。

原文摘要 · Abstract (English)

Medical image annotation is essential for diagnosing diseases, yet manual annotation is time-consuming, costly, and prone to variability among experts. To address these challenges, we propose an automated explainable annotation system that integrates ensemble learning, visual explainability, and uncertainty quantification. Our approach combines three pre-trained deep learning models - ResNet50, EfficientNet, and DenseNet - enhanced with XGrad-CAM for visual explanations and Monte Carlo Dropout for uncertainty quantification. This ensemble mimics the consensus of multiple radiologists by intersecting saliency maps from models that agree on the diagnosis while uncertain predictions are flagged for human review. We evaluated our system using the TBX11K medical imaging dataset and a Fire segmentation dataset, demonstrating its robustness across different domains. Experimental results show that our method outperforms baseline models, achieving 93.04% accuracy on TBX11K and 96.4% accuracy on the Fire dataset. Moreover, our model produces precise pixel-level annotations despite being trained with only image-level labels, achieving Intersection over Union IoU scores of 36.07% and 64.7%, respectively. By enhancing the accuracy and interpretability of image annotations, our approach offers a reliable and transparent solution for medical diagnostics and other image analysis tasks.

医学图像弱监督可解释性像素标注

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。