arXiv:2503.13828cs.CV2025-03ICLR被引 8

通过尺度感知对比蒸馏,提升无监督医学异常检测的准确性

Scale-Aware Contrastive Reverse Distillation for Unsupervised Medical Anomaly Detection

  • 设计对比师生学习机制,增强特征区分能力
  • 在多个基准数据集上达到领先性能,显著优于现有方法
  • 适合医学图像异常检测研究者,尤其关注尺度变化场景

无监督异常检测在深度学习中受到广泛关注,尤其在医疗影像领域,因标注异常数据稀缺而尤为重要。早期方法依赖自编码器和生成对抗网络(GANs),但常因过度泛化而表现不佳。近期方法探索记忆库、归一化流、自监督学习和知识蒸馏等策略以增强判别力。其中,反向知识蒸馏展现出潜力。本文提出一种新的尺度感知对比反向蒸馏模型,解决现有反向蒸馏方法在特征区分度不足和难以处理异常尺度变化方面的两个关键问题。具体而言,引入对比师生学习,通过生成并探索非正常分布来获取更具判别性的表示;同时设计尺度自适应机制,对不同尺度下的对比蒸馏损失进行软加权,以应对尺度变化。在多个基准数据集上的广泛实验验证了该方法的有效性,性能达到当前最优水平。代码已公开于 https://github.com/MedAITech/SCRD4AD。

原文摘要 · Abstract (English)

Unsupervised anomaly detection using deep learning has garnered significant research attention due to its broad applicability, particularly in medical imaging where labeled anomalous data are scarce. While earlier approaches leverage generative models like autoencoders and generative adversarial networks (GANs), they often fall short due to overgeneralization. Recent methods explore various strategies, including memory banks, normalizing flows, self-supervised learning, and knowledge distillation, to enhance discrimination. Among these, knowledge distillation, particularly reverse distillation, has shown promise. Following this paradigm, we propose a novel scale-aware contrastive reverse distillation model that addresses two key limitations of existing reverse distillation methods: insufficient feature discriminability and inability to handle anomaly scale variations. Specifically, we introduce a contrastive student-teacher learning approach to derive more discriminative representations by generating and exploring out-of-normal distributions. Further, we design a scale adaptation mechanism to softly weight contrastive distillation losses at different scales to account for the scale variation issue. Extensive experiments on benchmark datasets demonstrate state-of-the-art performance, validating the efficacy of the proposed method. Code is available at https://github.com/MedAITech/SCRD4AD.

医学图像异常检测知识蒸馏对比学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。