利用早期记忆效应,主动标注关键样本提升异常检测精度。
Memorize Early, Then Query: Inlier-Memorization-Guided Active Outlier Detection
- 分两阶段:先强化正常数据记忆,再主动选样放大异常区分度。
- 在多个数据集上优于顶尖方法,且计算开销更低。
- 适合标注成本高、异常样本难区分的工业场景使用。
异常检测(OD)旨在通过学习正常数据的典型模式(即内点)来识别异常实例。在无监督设置下(训练数据中不含异常信息),该任务极具挑战性。近期发现的内点记忆(IM)效应表明,深度生成模型在早期训练阶段倾向于记住正常模式,这为区分异常提供了潜在信号。然而,现有仅依赖IM效应的方法在内点与异常未充分分离或异常形成密集簇时仍表现不佳。为此,本文提出IMBoost框架,引入主动学习以有选择地获取关键标签,并显式增强IM效应以提升检测性能。方法包含两个阶段:1)预热阶段,诱导并促进IM效应;2)极化阶段,利用主动查询的样本最大化内点与异常得分的差异。特别地,设计了新颖的查询策略与定制损失函数,有效识别有信息量样本并充分利用有限标注预算。理论分析表明,IMBoost在整个训练过程中持续降低内点风险、提升异常风险,从而增强二者分离。大量实验显示,该方法不仅显著超越现有先进主动异常检测方法,且计算成本更低。
原文摘要 · Abstract (English)
Outlier detection (OD) aims to identify abnormal instances, known as outliers or anomalies, by learning typical patterns of normal data, or inliers. Performing OD under an unsupervised regime-without any information about anomalous instances in the training data-is challenging. A recently observed phenomenon, known as the inlier-memorization (IM) effect, where deep generative models (DGMs) tend to memorize inlier patterns during early training, provides a promising signal for distinguishing outliers. However, existing unsupervised approaches that rely solely on the IM effect still struggle when inliers and outliers are not well-separated or when outliers form dense clusters. To address these limitations, we incorporate active learning to selectively acquire informative labels, and propose IMBoost, a novel framework that explicitly reinforces the IM effect to improve outlier detection. Our method consists of two stages: 1) a warm-up phase that induces and promotes the IM effect, and 2) a polarization phase in which actively queried samples are used to maximize the discrepancy between inlier and outlier scores. In particular, we propose a novel query strategy and tailored loss function in the polarization phase to effectively identify informative samples and fully leverage the limited labeling budget. We provide a theoretical analysis showing that the IMBoost consistently decreases inlier risk while increasing outlier risk throughout training, thereby amplifying their separation. Extensive experiments on diverse benchmark datasets demonstrate that IMBoost not only significantly outperforms state-of-the-art active OD methods but also requires substantially less computational cost.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。