arXiv:2509.15711cs.CV2025-09被引 11

构建医疗伪造检测数据集与新方法,提升对生成医学影像的识别能力。

Toward Medical Deepfake Detection: A Comprehensive Dataset and Novel Method

  • 提出双阶段知识注入检测框架,融合视觉与语言特征空间。
  • 在六类医学影像上实现超越现有方法与人类专家的检测精度。
  • 首个涵盖十二种生成模型的医疗伪造检测数据集,支持跨模态研究。

生成式AI在医学影像中的快速发展带来了巨大机遇,也引发伪造图像威胁健康系统的风险,如误诊、金融欺诈和信息误导。然而,针对该领域的医学取证研究仍十分有限,缺乏专门的数据集,且现有媒体取证方法主要面向自然或人脸图像,难以捕捉生成医学图像的独特特征与细微痕迹。为此,我们推出了 extbf{MedForensics},一个涵盖六种医学模态和十二种前沿医学生成模型的大规模医学取证数据集。同时提出 extbf{DSKI}——一种新型双阶段知识注入检测器,通过构建专用于生成医学图像检测的视觉-语言特征空间,包含两个核心组件:1)跨域细粒度追踪适配器(CDFA),在训练中从空间与噪声域提取细微伪造线索;2)医学取证检索模块(MFRM),在测试中通过少样本检索提升检测准确率。实验表明,DSKI在多个医学模态下显著优于现有方法及人类专家,性能领先。

原文摘要 · Abstract (English)

The rapid advancement of generative AI in medical imaging has introduced both significant opportunities and serious challenges, especially the risk that fake medical images could undermine healthcare systems. These synthetic images pose serious risks, such as diagnostic deception, financial fraud, and misinformation. However, research on medical forensics to counter these threats remains limited, and there is a critical lack of comprehensive datasets specifically tailored for this field. Additionally, existing media forensic methods, which are primarily designed for natural or facial images, are inadequate for capturing the distinct characteristics and subtle artifacts of AI-generated medical images. To tackle these challenges, we introduce \textbf{MedForensics}, a large-scale medical forensics dataset encompassing six medical modalities and twelve state-of-the-art medical generative models. We also propose \textbf{DSKI}, a novel \textbf{D}ual-\textbf{S}tage \textbf{K}nowledge \textbf{I}nfusing detector that constructs a vision-language feature space tailored for the detection of AI-generated medical images. DSKI comprises two core components: 1) a cross-domain fine-trace adapter (CDFA) for extracting subtle forgery clues from both spatial and noise domains during training, and 2) a medical forensic retrieval module (MFRM) that boosts detection accuracy through few-shot retrieval during testing. Experimental results demonstrate that DSKI significantly outperforms both existing methods and human experts, achieving superior accuracy across multiple medical modalities.

医学伪造生成模型取证检测多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。