无需标注数据,用伪AUC挑选最优异常检测模型
AUCp: Pseudo-AUC for Inference Model Selection with Unlabeled Validation Data in Abnormality Detection

- 用未标注测试集构建伪标签,计算伪AUC选择最佳模型
- 在多种无监督/自监督方法上,比传统指标提升检测效果
- 适合标注困难的医学图像异常检测任务
异常检测在医学图像分析中至关重要但极具挑战。通过仅学习正常样本的重建来区分异常与正常数据,可减少对标注数据的依赖。然而,许多研究即使采用无监督方法,仍需依赖标注验证集从多次训练中选出最优推理模型。对于多数疾病,标注数据难以获取且耗时。为此,本文提出AUCp——一种支持无监督与自监督方法的新型评估指标。不同于传统基于重建图像真实性的评价方式,AUCp直接关注实际检测性能,无需标注测试集。假设测试集中所有未标注样本为异常(正类),使用传统AUC计算方式得出AUCp分数。在拥有大量代表性正常样本的前提下,我们从数学和实证两方面证明:以AUCp进行模型选择,能显著提升无监督与自监督方法的疾病检测能力。在神经疾病检测的两种无监督方法及多个数据集上的自监督方法中,结果表明AUCp能有效识别最优推理模型,大幅增强异常与疾病检测效果。代码已开源:https://github.com/mahfuzmohammad/AUCp。
原文摘要 · Abstract (English)
Abnormality detection is a crucial yet challenging task in medical image analysis. Distinguishing abnormalities from normal data by learning to reconstruct normal-only data alleviates the reliance on labeled datasets. However, many studies, even if unsupervised, rely on a labeled validation set to select the best model for inference from multiple training iterations. For many diseases labeled data are unavailable and substantially time consuming to obtain. To address this, AUCp - a novel metric that supports abnormality detection for unsupervised and self-supervised methods is proposed. Instead of evaluating the realism of reconstructed images to select the best of model for inference, it focuses on actual detection performance and without requiring an annotated test set. Assuming the pseudo ground truth of all unannotated samples in the test set as abnormal/positive and using traditional AUC calculation, AUCp scores are derived. Given a large and representative training set of normal samples, we show mathematical and empirical evidence that model selection using AUCp scores improves disease detection in terms of unsupervised and self-supervised methods over conventional metrics. Using two unsupervised methods for neurologic disease detection and self-supervised methods on diverse datasets, our results demonstrate that the AUCp score effectively identifies the optimal model for inference, significantly enhancing abnormality and disease detection. The corresponding implementations are available in https://github.com/mahfuzmohammad/AUCp.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。