arXiv:2604.25304cs.LG2026-04

用概率方法加速树模型规则提取,提升可解释性与效率

RCProb: Probabilistic Rule Extraction for Efficient Simplification of Tree Ensembles

  • 基于贝叶斯框架重构规则提取算法,避免重复扫描数据
  • 在33个数据集上提速22倍,规则集更紧凑且精度不降
  • 适合需要高效可解释模型的工业场景

树集成模型在工业机器学习中广泛应用,因其预测能力强且训练高效。但随着树的数量增加,模型难以解释。为解决此问题,可解释人工智能(XAI)提出从树集成中提取决策规则的方法,以保持原模型预测性能的同时提升可读性。此前我们提出了RuleCOSI+,一种基于贪心启发式的规则提取算法。尽管其生成的规则集准确且易懂,但依赖对训练数据反复进行频率统计来估算规则置信度,导致大规模数据下计算成本高昂。本文提出RCProb,对RuleCOSI+进行概率化重构:通过狄利克雷平滑类先验和贝塔平滑条件似然,结合朴素贝叶斯框架估算规则统计量,无需重复扫描数据。在33个基准数据集上的实验表明,RCProb在保持竞争性预测性能的同时,运行时间较RuleCOSI+降低约22倍,并平均生成更紧凑的规则集。

原文摘要 · Abstract (English)

Tree ensembles are widely used in industrial machine learning due to their strong predictive performance and efficient training procedures. However, as the number of trees in an ensemble grows, the resulting models become increasingly difficult for humans to interpret. To address this limitation, explainable artificial intelligence (XAI) studies methods that generate interpretable models capable of explaining complex predictors. One approach consists of extracting decision rules from tree ensembles while attempting to preserve the predictive performance of the original model. In previous work, we introduced RuleCOSI+, a greedy heuristic algorithm for extracting compact rule-based models from tree ensembles. Although RuleCOSI+ produces accurate and interpretable rule sets, it relies on repeated empirical frequency counting over the training data to estimate rule confidence, which becomes computationally expensive for large datasets. In this paper, we propose RCProb, a probabilistic reformulation of RuleCOSI+ designed to reduce the computational cost of rule extraction. RCProb estimates rule statistics using Dirichlet-smoothed class priors and Beta-smoothed condition likelihoods combined through a Naive Bayes formulation, avoiding repeated dataset scans. Experiments on 33 benchmark datasets show that RCProb maintains competitive predictive performance while reducing runtime by approximately $22\times$ compared with RuleCOSI+, while producing more compact rule sets on average.

可解释性规则提取树模型概率建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。