通过分治蒸馏让模型自动区分异常,无需标注也能精准检测。
Isolating to Harness: Cross-Division Distillation for Fully Unsupervised Anomaly Detection
- 将数据分块降低异常比例,分块训练学生模型
- 跨块协作生成伪正常特征,提升整体表征能力
- 适合无标签异常检测场景,尤其在噪声数据中表现优异
完全无监督异常检测(FUAD)应对训练数据中混入未标注异常的实际挑战。传统无监督方法易将异常误判为正常,导致漏检。尽管数据过滤可缓解问题,但会损失有效样本并削弱对正常模式的建模。为此,本文提出“隔离以利用”策略:先在各子集内隔离异常影响,再通过跨子集协作生成鲁棒伪监督信号。我们基于逆蒸馏范式构建了跨分部蒸馏(CDD)框架:首先将数据划分为异常率较低的子集,训练各子集专属的学生模型;随后,利用各子集学生模型对其他子集样本生成伪正常特征,指导全局学生模型学习无异常表示。在多个数据集的含噪版本上实验表明,本方法显著优于基线。代码已公开于 https://github.com/hito2448/CDD。
原文摘要 · Abstract (English)
Fully Unsupervised Anomaly Detection (FUAD) addresses the practical scenario where training data is contaminated with unlabeled anomalies. This setting critically challenges conventional Unsupervised Anomaly Detection (UAD) methods, as they tend to misinterpret training anomalies as normal patterns, leading to false negatives. Although filtering anomalies from the training set is a common countermeasure, it inevitably discards valuable data and degrades the model's representation of normality. To overcome this dilemma, we propose an "isolating to harness" strategy, which isolates the influence of anomalies within specialized divisions and then leverages cross-division collaboration to generate robust pseudo supervision. We materialize this idea via a novel Cross-Division Distillation framework based on the widely studied Reverse Distillation paradigm. CDD first partitions the data into divisions with reduced anomaly ratios to train division-specific students. It then aggregates pseudo-normal features generated by each division-specific student for samples from other data divisions to guide a global student towards a robust anomaly-free representation. Experimental results on noisy versions of multiple AD datasets demonstrate that our method achieves significant performance improvements over the baseline. Code is available at https://github.com/hito2448/CDD.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。