用标签控制生成真实脑部病灶图像,助力医疗AI可解释性验证。
Local Label-Informed Feature Transfer for Generating Ground-Truth Medical Images: A Comparison of GAN- and Diffusion-Based Approaches

- 基于标签而非像素标注,通过局部特征迁移生成病灶。
- 两类模型生成图像与真实病变分布相似度高,FID接近健康与病变间差异。
- 适合需要可控病灶位置的医疗AI可解释性研究者使用。
验证医疗影像中可解释人工智能(XAI)方法需具备已知信息特征位置的真实数据,但现有方法依赖易出错的专家标注,或在健康图像上人工添加病灶,缺乏临床真实性。本文提出局部标签引导特征迁移(LLIFT)框架,可在用户指定区域生成具有真实感病灶的半合成脑部磁共振图像,训练无需像素级病灶标注。采用两种生成范式:基于自定义GAN的LLIFT-GAN,仅从二值类别标签学习病理特征;以及基于扩散模型的LLIFT-DM,通过ControlNet以边界框掩码条件化修复。两者均在人类连接组计划(HCP)脑部MRI数据上评估,结果表明其生成图像与真实病理分布的弗雷谢特起始距离(FID)得分,与数据集中健康与病理图像间的类间参考值相当。定性分析确认病灶结构真实。生成的数据集为医疗影像XAI方法评估提供了空间可控的真实基准。
原文摘要 · Abstract (English)
Validating Explainable Artificial Intelligence (XAI) methods in medical imaging requires ground-truth data with known locations of informative features. However, current approaches rely on expert annotations, which are prone to labeling errors, or on hand-crafted artificial perturbations superimposed onto healthy images to mimic lesions or malignant features, which lack clinical realism. We present Local Label-Informed Feature Transfer (LLIFT), a framework for generating semi-synthetic brain magnetic resonance images with realistic lesions placed in user-controlled regions, which does not require pixel-level lesion annotations during training. We implement LLIFT with two generative paradigms: LLIFT-GAN, a custom GAN that learns pathological features from binary class labels alone, and LLIFT-DM, a diffusion-based inpainting pipeline conditioned on bounding-box masks via ControlNet. Both approaches are evaluated on brain magnetic resonance imaging data derived from the Human Connectome Project. In evaluations, both achieve Fréchet Inception Distance scores, with respect to the real pathological distribution, that are comparable to the inter-class reference between healthy and pathological images in the given dataset. Furthermore, qualitative inspection confirms the realism of lesion structures. The resulting benchmark datasets provide spatially controlled ground truth data for evaluating XAI methods in medical imaging.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。