arXiv:2509.08640eess.IVcs.AI2025-09被引 4

用合成影像检测并纠正肺部X光模型的错误依赖问题

RoentMod: A Synthetic Chest X-Ray Modification Model to Identify and Correct Image Interpretation Model Shortcuts

  • 通过可控生成带特定病灶的逼真胸片,模拟反事实场景
  • 训练时加入合成数据后,模型在6种病灶上准确率提升1-19%
  • 适合医疗AI研究者、临床验证团队及模型可解释性开发者

胸部X光(CXRs)是医学中最常见的检查之一。自动化图像解读可减轻放射科医生负担并扩大诊断资源覆盖。尽管深度学习多任务与基础模型在CXR解读中表现优异,但易出现捷径学习,即依赖非相关特征而非临床关键特征做判断。我们提出RoentMod,一种反事实图像编辑框架,可在保持原始扫描无关解剖结构的前提下,生成带有用户指定合成病灶的解剖真实胸片。RoentMod结合开源医学图像生成器RoentGen与图像到图像修改模型,无需重新训练。放射科医生和住院医师读者研究显示,93%的生成图像外观真实,89%-99%正确融入指定病灶,且原生解剖结构保留程度接近真实随访影像。利用RoentMod,我们发现当前先进多任务与基础模型常依赖非目标病灶作为捷径,限制其特异性。在训练中引入罗恩特模生成的反事实图像后,内部验证中模型对多种病灶的判别能力提升3%-19% AUC,外部测试中5/6种病灶提升1%-11%。结果表明RoentMod是探测与纠正医学AI中捷径学习的通用工具,通过可控反事实干预,显著提升胸部影像模型的鲁棒性与可解释性,并为医学影像基础模型优化提供可推广策略。

原文摘要 · Abstract (English)

Chest radiographs (CXRs) are among the most common tests in medicine. Automated image interpretation may reduce radiologists\' workload and expand access to diagnostic expertise. Deep learning multi-task and foundation models have shown strong performance for CXR interpretation but are vulnerable to shortcut learning, where models rely on spurious and off-target correlations rather than clinically relevant features to make decisions. We introduce RoentMod, a counterfactual image editing framework that generates anatomically realistic CXRs with user-specified, synthetic pathology while preserving unrelated anatomical features of the original scan. RoentMod combines an open-source medical image generator (RoentGen) with an image-to-image modification model without requiring retraining. In reader studies with board-certified radiologists and radiology residents, RoentMod-produced images appeared realistic in 93\% of cases, correctly incorporated the specified finding in 89-99\% of cases, and preserved native anatomy comparable to real follow-up CXRs. Using RoentMod, we demonstrate that state-of-the-art multi-task and foundation models frequently exploit off-target pathology as shortcuts, limiting their specificity. Incorporating RoentMod-generated counterfactual images during training mitigated this vulnerability, improving model discrimination across multiple pathologies by 3-19\% AUC in internal validation and by 1-11\% for 5 out of 6 tested pathologies in external testing. These findings establish RoentMod as a broadly applicable tool for probing and correcting shortcut learning in medical AI. By enabling controlled counterfactual interventions, RoentMod enhances the robustness and interpretability of CXR interpretation models and provides a generalizable strategy for improving foundation models in medical imaging.

医学影像模型可解释性生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。