arXiv:2512.21264cs.CV2025-12被引 1

解决脑部MRI异常检测中模态缺失问题,实现任意模态组合下的统一异常检测。

AnyAD: Unified Any-Modality Anomaly Detection in Incomplete Multi-Sequence MRI

  • 采用双路径DINOv2编码器与特征分布对齐机制,适应不完整模态输入。
  • 在7种模态组合上超越现有方法,异常定位准确率提升显著。
  • 适合临床场景中模态不全的医学影像分析,尤其适用于缺乏标注数据时。

由于标注异常病例稀缺及真实临床流程中常缺失关键影像模态,脑部MRI的可靠异常检测仍具挑战。现有单类或多类异常检测模型通常依赖固定模态配置,需重复训练,或无法泛化至未见模态组合,限制其临床可扩展性。本文提出统一的Any-Modality AD框架,在任意模态缺失条件下实现稳健的异常检测与定位。该框架融合双路径DINOv2编码器与特征分布对齐机制,统计对齐不完整模态特征与全模态表示,支持严重模态缺失下的稳定推理。为进一步增强语义一致性,引入内在正常原型(INPs)提取器与INP引导解码器,仅重建正常解剖模式,自然放大异常偏差。通过随机模态掩码与间接特征补全训练,模型无需重训即可适应所有模态配置。在BraTS2018、MU-Glioma-Post和Pretreat-MetsToBrain-Masks数据集上的大量实验表明,本方法在7种模态组合下持续优于先进工业与医疗异常检测基线,展现出卓越泛化能力。本研究建立了一种面向真实世界不完美模态条件的可扩展多模态医学异常检测范式。源代码已公开于https://github.com/wuchangw/AnyAD。

原文摘要 · Abstract (English)

Reliable anomaly detection in brain MRI remains challenging due to the scarcity of annotated abnormal cases and the frequent absence of key imaging modalities in real clinical workflows. Existing single-class or multi-class anomaly detection (AD) models typically rely on fixed modality configurations, require repetitive training, or fail to generalize to unseen modality combinations, limiting their clinical scalability. In this work, we present a unified Any-Modality AD framework that performs robust anomaly detection and localization under arbitrary MRI modality availability. The framework integrates a dual-pathway DINOv2 encoder with a feature distribution alignment mechanism that statistically aligns incomplete-modality features with full-modality representations, enabling stable inference even with severe modality dropout. To further enhance semantic consistency, we introduce an Intrinsic Normal Prototypes (INPs) extractor and an INP-guided decoder that reconstruct only normal anatomical patterns while naturally amplifying abnormal deviations. Through randomized modality masking and indirect feature completion during training, the model learns to adapt to all modality configurations without re-training. Extensive experiments on BraTS2018, MU-Glioma-Post, and Pretreat-MetsToBrain-Masks demonstrate that our approach consistently surpasses state-of-the-art industrial and medical AD baselines across 7 modality combinations, achieving superior generalization. This study establishes a scalable paradigm for multimodal medical AD under real-world, imperfect modality conditions. Our source code is available at https://github.com/wuchangw/AnyAD.

异常检测MRI多模态深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。