通过频域分析识别医学伪造影像,有效区分真实与生成图像。
The K-Space Signature: Frequency-Domain Representation Learning for Medical Deepfake Detection

- 在频域提取硬件与生成痕迹,抑制解剖结构差异干扰
- 多中心3D MRI数据上准确率超0.99,零样本泛化达0.93
- 适合医疗图像安全、深度伪造检测研究者使用
在医学影像中,生成模型被广泛用于合成逼真数据以扩充有限数据集。然而,这些合成图像可能被恶意重用,制造医学深度伪造,威胁公共健康。为此,我们提出一种名为K-Space Signature(KSS)的新颖取证框架,将分析从空间域转移到频域,通过在对数功率谱密度(Log-PSD)空间计算经验全局解剖先验并减去,抑制宏观解剖差异。为有效处理全局分布的频域伪影,同时避免卷积神经网络带来的局部空间偏差,我们采用新型3D MLP-Mixer架构,并搭配ArcFace度量学习头。在多个中心的3D MRI数据集上,该方法在多生成器合成数据上达到超过0.99的准确率和ROC-AUC;此外,在完全未见过的扫描仪采集的独立数据集上仍保持高达0.93的准确率,展现强大零样本泛化能力。为确保可复现性,完整源代码与预训练模型将在论文接收后公开。
原文摘要 · Abstract (English)
In medical imaging, generative models are increasingly deployed to synthesize realistic data and augment limited datasets. Unfortunately, while beneficial for privacy-preserving data sharing, these synthesized images can be repurposed for malicious intents, threatening public health through the creation of Medical Deepfakes. To address this threat, we introduce the K-Space Signature (KSS), a novel forensic framework that isolates hardware and generative traces within the spectral domain. By shifting analysis to the frequency domain, the KSS suppresses macroscopic anatomical variance by subtracting an empirical global anatomical prior computed in the Logarithmic Power Spectral Density (Log-PSD) space. To effectively process these globally distributed spectral artifacts without the local spatial bias inherent to Convolutional Neural Networks, we pair the KSS representation with a novel 3D MLP-Mixer architecture equipped with an ArcFace metric-learning head. Extensive experiments on multi-center 3D MRI datasets demonstrate that this combined approach achieves exceptional detection performance, exceeding 0.99 Accuracy and ROC-AUC on multi-generator synthetic datasets. Furthermore, the framework exhibits robust zero-shot generalization, maintaining strong discriminative power (up to 0.93 Accuracy) on independent datasets acquired from entirely unseen scanners. To ensure full reproducibility, the complete source code and pre-trained models will be made publicly available upon acceptance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。