arXiv:2510.08747cs.LGcs.DB2025-10被引 2

用随机森林做表格数据异常检测,既准又可解释。

RFOD: Random Forest-based Outlier Detection for Tabular Data

  • 为每个特征建独立随机森林,条件依赖其他特征进行重建
  • 在15个真实数据集上优于现有方法,准确率显著提升
  • 能定位异常值,适合金融、医疗等需可解释性的场景

表格数据中的异常检测对网络安全、金融反欺诈和医疗等高风险领域至关重要,异常可能引发重大运营与经济损失。尽管数据挖掘和深度学习取得进展,现有方法在混合类型表格数据上仍面临挑战,常依赖编码方式导致语义丢失,且缺乏可解释性,难以定位异常原因。为此,我们提出基于随机森林的异常检测框架 RFOD,将异常检测重构为特征级条件重建问题,为每个特征训练基于其他特征的专用随机森林。该设计有效处理异构数据类型,保留类别特征的语义完整性。为进一步实现精准可解释检测,RFOD 结合调整后的 Gower 距离(AGD)进行单元级评分,适应偏态数值数据并考虑类别置信度,并采用不确定性加权平均(UWA)将单元级得分聚合为鲁棒的行级异常分数。在15个真实世界数据集上的大量实验表明,RFOD 在检测准确率上持续优于先进基线方法,同时具备更强的鲁棒性、可扩展性和可解释性。

原文摘要 · Abstract (English)

Outlier detection in tabular data is crucial for safeguarding data integrity in high-stakes domains such as cybersecurity, financial fraud detection, and healthcare, where anomalies can cause serious operational and economic impacts. Despite advances in both data mining and deep learning, many existing methods struggle with mixed-type tabular data, often relying on encoding schemes that lose important semantic information. Moreover, they frequently lack interpretability, offering little insight into which specific values cause anomalies. To overcome these challenges, we introduce \textsf{\textbf{RFOD}}, a novel \textsf{\textbf{R}}andom \textsf{\textbf{F}}orest-based \textsf{\textbf{O}}utlier \textsf{\textbf{D}}etection framework tailored for tabular data. Rather than modeling a global joint distribution, \textsf{RFOD} reframes anomaly detection as a feature-wise conditional reconstruction problem, training dedicated random forests for each feature conditioned on the others. This design robustly handles heterogeneous data types while preserving the semantic integrity of categorical features. To further enable precise and interpretable detection, \textsf{RFOD} combines Adjusted Gower's Distance (AGD) for cell-level scoring, which adapts to skewed numerical data and accounts for categorical confidence, with Uncertainty-Weighted Averaging (UWA) to aggregate cell-level scores into robust row-level anomaly scores. Extensive experiments on 15 real-world datasets demonstrate that \textsf{RFOD} consistently outperforms state-of-the-art baselines in detection accuracy while offering superior robustness, scalability, and interpretability for mixed-type tabular data.

异常检测随机森林表格数据可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。