通过解耦属性关系提升表格数据异常检测效果
Disentangling Tabular Data Towards Better One-Class Anomaly Detection
- 将正常数据属性分为两组互斥的相关集合,显式学习内在关联
- 在20个数据集上平均提升6.1% AUC-PR和2.1% AUC-ROC
- 首次将解耦思想用于表格数据的一类异常检测,适合数据质量要求高场景
在单类别异常检测设置下,表格数据的异常检测面临重大挑战:必须仅从单一类别中准确构建“正常”概念,以区分正常数据变化与异常。捕捉正常样本中属性间的内在相关性是一种有效方法。现有方法依赖可学习掩码策略配合重构任务,但易产生均匀掩码(即几乎无掩码),导致相关性学习效果不佳。为此,我们假设正常样本中与其他属性相关的属性可划分为两个不重叠且相互关联的子集,称为CorrSets,以更有效地捕捉内在关联。基于此,我们提出一种新方法,从正常表格数据中解耦出CorrSets。据我们所知,这是首个将解耦思想应用于表格数据一类别异常检测的工作。在20个表格数据集上的大量实验表明,该方法显著优于现有最先进方法,在AUC-PR上平均提升6.1%,在AUC-ROC上平均提升2.1%。代码已公开于https://github.com/yjnanan/Disent-AD。
原文摘要 · Abstract (English)
Tabular anomaly detection under the one-class classification setting poses a significant challenge, as it involves accurately conceptualizing "normal" derived exclusively from a single category to discern anomalies from normal data variations. Capturing the intrinsic correlation among attributes within normal samples presents one promising method for learning the concept. To do so, the most recent effort relies on a learnable mask strategy with a reconstruction task. However, this wisdom may suffer from the risk of producing uniform masks, i.e., essentially nothing is masked, leading to less effective correlation learning. To address this issue, we presume that attributes related to others in normal samples can be divided into two non-overlapping and correlated subsets, defined as CorrSets, to capture the intrinsic correlation effectively. Accordingly, we introduce an innovative method that disentangles CorrSets from normal tabular data. To our knowledge, this is a pioneering effort to apply the concept of disentanglement for one-class anomaly detection on tabular data. Extensive experiments on 20 tabular datasets show that our method substantially outperforms the state-of-the-art methods and leads to an average performance improvement of 6.1% on AUC-PR and 2.1% on AUC-ROC. Codes are available at https://github.com/yjnanan/Disent-AD.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。