arXiv:2608.05101cs.CVcs.MM2026-08中稿 · ACM Multimedia 202…

提出可解释的医疗伪造检测方法,无需标注即可定位篡改区域。

HexMIL: Hierarchical Attention MIL for Ante-Hoc Explainable Detection of AI-Manipulated CT Volumes

论文配图:HexMIL: Hierarchical Attention MIL for Ante-Hoc Explainable Detection of AI-Manipulated CT Volumes
图 1 · 摘自论文原文
  • 分层注意力机制分解CT体数据,通过门控注意力聚合特征
  • 跨生成模型测试提升9.1 AUC和9.4 F1,定位准确率最优
  • 检测结果可直接解释分类决策过程,适合临床可信验证

医学深度伪造(如由生成模型操纵的CT图像)对临床流程构成严重威胁。现有检测方法存在两大缺陷:对未见过的生成架构泛化能力差,且缺乏可解释性。本文提出HexMIL(层级可解释多重实例学习),一种仅需体积级二值标签的无掩码检测器。HexMIL将每份CT体积分解为切片与补丁的两级层次结构,通过独立的门控注意力模块聚合,并将权重融合为全分辨率3D注意力图,精确定位篡改子区域,无需像素级标注。与后处理方法(如Grad-CAM)不同,HexMIL的注意力权重是分类决策的直接计算组成部分,实现事前可解释且结构一致的空间归因。在M3DSynth和CT-GAN数据集上,采用严格的跨生成器泛化协议评估:仅用单一生成架构训练,测试未见架构。HexMIL在域外分类中优于所有基线9.1 AUC和9.4 F1;定位任务上达到最佳平均IoU与指向游戏得分。

原文摘要 · Abstract (English)

The emergence of medical deepfakes, i.e., medical images manipulated by deep generative models, poses a significant threat to clinical workflows. However, existing detectors suffer from two critical limitations: poor generalization to unseen generative architectures for manipulation detection and lack of interpretability. In this context, we present HexMIL (Hierarchical EXplainable Multiple Instance Learning), a mask-free medical deepfake detector that simultaneously addresses both limitations using only binary volume-level supervision. HexMIL decomposes each CT volume into a two-level hierarchy of patches and slices, aggregated via independent Gated Attention modules whose weights are directly combined into a full-resolution 3D attention volume that localizes the manipulated sub-region without any pixel-level annotation. Unlike post-hoc methods such as Grad-CAM, HexMIL's attention weights constitute the exact forward computation driving the classification decision, providing ante-hoc and structurally faithful spatial attribution. We evaluate HexMIL on M3DSynth and CT-GAN datasets under a rigorous cross-generator generalization protocol, training on a single generative architecture and testing on unseen ones. HexMIL outperforms all baselines by $+9.1$ AUC and $+9.4$ F1 in out-of-domain classification, and achieves the best average IoU and Pointing Game score in localization. Project page: opontorno.github.io/hexmil.

医学伪造检测可解释性多实例学习3D注意力

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。