提出首个全无监督异常检测过滤方法,有效处理噪声数据。
A Synergy Scoring Filter for Unsupervised Anomaly Detection with Noisy Data
- 基于样本级过滤与互块比较机制,动态评估异常得分
- 在Real-IAD数据集上达最优性能,显著提升模型鲁棒性
- 适合工业场景中存在噪声的无监督异常检测任务
包含噪声的全无监督异常检测(FUAD)具有重要实际意义。尽管已有多种方法应对该问题,但性能和可扩展性仍受限。本文提出首个完全无监督的异常检测方法——协同评分过滤器(SSFilter),首次引入样本级过滤机制。该方法通过批级异常评分结合异常区域的回归误差与预测不确定性,生成样本级不确定度分数,校准异常评分机制,实现端到端鲁棒训练,并在训练后对整个训练集进行过滤,具备模型无关性。此外,我们设计了一种真实异常合成方法与完整性增强策略,提升模型训练效果并减少漏检噪声样本。在近期大规模工业异常检测数据集Real-IAD的FUAD基准上,本方法达到当前最优性能;且数据集级过滤可提升多种UAD方法表现,方法高可扩展性显著增强其实际应用价值。
原文摘要 · Abstract (English)
Noise-inclusive fully unsupervised anomaly detection (FUAD) holds significant practical relevance. Although various methods exist to address this problem, they are limited in both performance and scalability. Our work seeks to overcome these obstacles, enabling broader adaptability of unsupervised anomaly detection (UAD) models to FUAD. To achieve this, we introduce the Synergy Scoring Filter (SSFilter), the first fully unsupervised anomaly detection approach to leverage sample-level filtering. SSFilter facilitates end-to-end robust training and applies filtering to the complete training set post-training, offering a model-agnostic solution for FUAD. Specifically, SSFilter integrates a batch-level anomaly scoring mechanism based on mutual patch comparison and utilizes regression errors in anomalous regions, alongside prediction uncertainty, to estimate sample-level uncertainty scores that calibrate the anomaly scoring mechanism. This design produces a synergistic, robust filtering approach. Furthermore, we propose a realistic anomaly synthesis method and an integrity enhancement strategy to improve model training and mitigate missed noisy samples. Our method establishes state-of-the-art performance on the FUAD benchmark of the recent large-scale industrial anomaly detection dataset, Real-IAD. Additionally, dataset-level filtering enhances the performance of various UAD methods on the FUAD benchmark, and the high scalability of our approach significantly boosts its practical applicability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。