用预训练视觉特征实现无需标注的医学图像异常检测
DINO-AD: Unsupervised Anomaly Detection with Frozen DINO-V3 Features
- 基于DINO-V3特征,通过语义匹配选支持图
- 采用前景感知聚类建模正常特征分布,异常得分由余弦相似度计算
- 在脑和肝数据集上达98.71的AUROC,适合医疗诊断场景
无监督医学图像异常检测旨在不依赖像素级标注的情况下识别异常区域,对构建可扩展、低标注成本的诊断系统至关重要。本文提出基于DINO-V3表征的新框架DINO-AD,利用自监督视觉特征实现精确且可解释的异常定位。具体而言,引入嵌入相似性匹配策略选择语义对齐的支持图像,并设计前景感知K均值聚类模块以建模正常特征分布。通过查询特征与聚类后的正常嵌入之间的余弦相似度计算异常图。在脑和肝数据集上的实验结果表明,该方法在定量性能上优于当前最先进方法,最高达到98.71的AUROC。定性结果进一步验证了框架能生成更清晰、准确的异常定位。大量消融实验验证了各组件的有效性,凸显了方法的鲁棒性与泛化能力。
原文摘要 · Abstract (English)
Unsupervised anomaly detection (AD) in medical images aims to identify abnormal regions without relying on pixel-level annotations, which is crucial for scalable and label-efficient diagnostic systems. In this paper, we propose a novel anomaly detection framework based on DINO-V3 representations, termed DINO-AD, which leverages self-supervised visual features for precise and interpretable anomaly localization. Specifically, we introduce an embedding similarity matching strategy to select a semantically aligned support image and a foreground-aware K-means clustering module to model the distribution of normal features. Anomaly maps are then computed by comparing the query features with clustered normal embeddings through cosine similarity. Experimental results on both the Brain and Liver datasets demonstrate that our method achieves superior quantitative performance compared with state-of-the-art approaches, achieving AUROC scores of up to 98.71. Qualitative results further confirm that our framework produces clearer and more accurate anomaly localization. Extensive ablation studies validate the effectiveness of each proposed component, highlighting the robustness and generalizability of our approach.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。