arXiv:2502.17836eess.IVcs.CV2025-02被引 1

用图像级标签生成病灶像素图,让AI诊断更透明

TagGAN: A Generative Model for Data Tagging

  • 基于GAN框架,从图像级标签生成像素级病变图
  • 在3个医学数据集上优于现有模型,精准定位病灶区域
  • 适合需要可解释性医疗AI的临床场景

精准识别和定位医学图像中疾病特异性特征的像素级信息,对早期诊断、疾病进展监测和有效治疗至关重要。然而,传统诊断AI系统缺乏决策透明度,且在缺乏像素级标注的环境下表现不佳。本文提出一种基于生成对抗网络(GAN)的新框架TagGAN,专为仅使用图像级标签的弱监督细粒度疾病图生成而设计。TagGAN在将异常图像转换为正常表征的过程中生成像素级疾病图,再将其从输入异常图像中减去,得到保留关键解剖细节的正常图像。该方法首次在无像素级标注的弱监督设置下生成细粒度疾病图,提升诊断AI的可解释性,并实现自动化二值掩码生成,辅助放射科医生。在CheXpert、TBX11K和COVID-19等基准数据集上的实证评估表明,TagGAN在准确识别疾病特异性像素方面优于当前顶尖模型,显著降低放射科医生在训练阶段制作二值掩码的工作量。

原文摘要 · Abstract (English)

Precise identification and localization of disease-specific features at the pixel-level are particularly important for early diagnosis, disease progression monitoring, and effective treatment in medical image analysis. However, conventional diagnostic AI systems lack decision transparency and cannot operate well in environments where there is a lack of pixel-level annotations. In this study, we propose a novel Generative Adversarial Networks (GANs)-based framework, TagGAN, which is tailored for weakly-supervised fine-grained disease map generation from purely image-level labeled data. TagGAN generates a pixel-level disease map during domain translation from an abnormal image to a normal representation. Later, this map is subtracted from the input abnormal image to convert it into its normal counterpart while preserving all the critical anatomical details. Our method is first to generate fine-grained disease maps to visualize disease lesions in a weekly supervised setting without requiring pixel-level annotations. This development enhances the interpretability of diagnostic AI by providing precise visualizations of disease-specific regions. It also introduces automated binary mask generation to assist radiologists. Empirical evaluations carried out on the benchmark datasets, CheXpert, TBX11K, and COVID-19, demonstrate the capability of TagGAN to outperform current top models in accurately identifying disease-specific pixels. This outcome highlights the capability of the proposed model to tag medical images, significantly reducing the workload for radiologists by eliminating the need for binary masks during training.

医学图像弱监督GAN可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。