提出可解释的医疗伪造检测方法,无需标注即可定位篡改区域。
HexMIL: Hierarchical Attention MIL for Ante-Hoc Explainable Detection of AI-Manipulated CT Volumes

- 分层注意力机制分解CT体数据,通过门控注意力聚合特征
- 跨生成模型测试提升9.1 AUC和9.4 F1,定位准确率最优
- 检测结果可直接解释分类决策过程,适合临床可信验证
医学深度伪造(如由生成模型操纵的CT图像)对临床流程构成严重威胁。现有检测方法存在两大缺陷:对未见过的生成架构泛化能力差,且缺乏可解释性。本文提出HexMIL(层级可解释多重实例学习),一种仅需体积级二值标签的无掩码检测器。HexMIL将每份CT体积分解为切片与补丁的两级层次结构,通过独立的门控注意力模块聚合,并将权重融合为全分辨率3D注意力图,精确定位篡改子区域,无需像素级标注。与后处理方法(如Grad-CAM)不同,HexMIL的注意力权重是分类决策的直接计算组成部分,实现事前可解释且结构一致的空间归因。在M3DSynth和CT-GAN数据集上,采用严格的跨生成器泛化协议评估:仅用单一生成架构训练,测试未见架构。HexMIL在域外分类中优于所有基线9.1 AUC和9.4 F1;定位任务上达到最佳平均IoU与指向游戏得分。
原文摘要 · Abstract (English)
The emergence of medical deepfakes, i.e., medical images manipulated by deep generative models, poses a significant threat to clinical workflows. However, existing detectors suffer from two critical limitations: poor generalization to unseen generative architectures for manipulation detection and lack of interpretability. In this context, we present HexMIL (Hierarchical EXplainable Multiple Instance Learning), a mask-free medical deepfake detector that simultaneously addresses both limitations using only binary volume-level supervision. HexMIL decomposes each CT volume into a two-level hierarchy of patches and slices, aggregated via independent Gated Attention modules whose weights are directly combined into a full-resolution 3D attention volume that localizes the manipulated sub-region without any pixel-level annotation. Unlike post-hoc methods such as Grad-CAM, HexMIL's attention weights constitute the exact forward computation driving the classification decision, providing ante-hoc and structurally faithful spatial attribution. We evaluate HexMIL on M3DSynth and CT-GAN datasets under a rigorous cross-generator generalization protocol, training on a single generative architecture and testing on unseen ones. HexMIL outperforms all baselines by $+9.1$ AUC and $+9.4$ F1 in out-of-domain classification, and achieves the best average IoU and Pointing Game score in localization. Project page: opontorno.github.io/hexmil.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。