arXiv:2509.12512eess.IVcs.AI2025-09ICCV被引 3

用注意力聚合2D模型特征,提升3D脑部MRI异常分类性能

DinoAtten3D: Slice-Level Attention Aggregation of DinoV2 for 3D Brain MRI Anomaly Classification

  • 基于DINOv2提取切片特征,用软注意力机制动态加权
  • 在ADNI和头痛队列上实现高准确率,克服数据少与类别不平衡
  • 适合医疗影像异常检测研究者,尤其关注少样本场景

医学影像中的异常检测与分类对早期诊断至关重要,但受限于标注数据少、类别不平衡及专家标注成本高。新兴视觉基础模型如DINOv2,在大规模无标签数据上预训练,可提供通用表征,有望缓解上述问题。本文提出一种专用于3D医学图像异常分类的注意力全局聚合框架。利用自监督DINOv2作为特征提取器,处理脑部MRI的单个2D轴向切片,通过软注意力机制为每一切片分配自适应重要性权重。为应对数据稀缺,采用结合监督对比学习与类方差正则化的复合损失函数,增强类间可分性与类内一致性。在ADNI数据集和机构多类头痛队列上验证,即使在数据有限且类别严重不平衡条件下,仍表现出优异的分类性能。结果表明,结合预训练2D基础模型与注意力切片聚合,能有效实现医学影像中鲁棒的三维异常检测。代码已公开于https://github.com/Rafsani/DinoAtten3D.git。

原文摘要 · Abstract (English)

Anomaly detection and classification in medical imaging are critical for early diagnosis but remain challenging due to limited annotated data, class imbalance, and the high cost of expert labeling. Emerging vision foundation models such as DINOv2, pretrained on extensive, unlabeled datasets, offer generalized representations that can potentially alleviate these limitations. In this study, we propose an attention-based global aggregation framework tailored specifically for 3D medical image anomaly classification. Leveraging the self-supervised DINOv2 model as a pretrained feature extractor, our method processes individual 2D axial slices of brain MRIs, assigning adaptive slice-level importance weights through a soft attention mechanism. To further address data scarcity, we employ a composite loss function combining supervised contrastive learning with class-variance regularization, enhancing inter-class separability and intra-class consistency. We validate our framework on the ADNI dataset and an institutional multi-class headache cohort, demonstrating strong anomaly classification performance despite limited data availability and significant class imbalance. Our results highlight the efficacy of utilizing pretrained 2D foundation models combined with attention-based slice aggregation for robust volumetric anomaly detection in medical imaging. Our implementation is publicly available at https://github.com/Rafsani/DinoAtten3D.git.

3D MRI异常检测注意力机制DINOv2

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。