提出可审计的树集成模型,让每条预测都可追溯到不重叠的规则贡献。
Learning Auditable Classifier Models: Source-Disjoint Tree Ensembles

- 分三阶段学习:先生成符号特征,再构建源不交集的浅层树,最后用稀疏回归求系数。
- 在12个临床数据集上,审计复杂度比XGBoost低9到87倍,优于EBM和RuleFit。
- 适合医疗等需严格审计的场景,确保每个预测都能被清晰解释和验证。
临床与受监管场景中的预测模型需兼具高准确率与完全可审计性。树集成在表格数据上表现优异,但其序列化提升将结构发现与系数估计耦合,难以实现逐预测的紧凑审计。可解释替代方案施加结构约束,限制表达能力:广义加性模型通常仅支持成对交互,后验规则提取器生成重叠规则,阻碍简洁解释。本文提出残差模式树集成(RPTE),采用三阶段学习方法,基于三个核心原则:有限特征预算、源不交集、系数分离估计。第一阶段构建监督式符号特征词表;第二阶段在源不交集约束下生长浅层树,每个原始变量仅分配给一棵树,并保留所发现的树结构;第三阶段对叶区指示变量求解单一ℓ₁正则化逻辑回归,获得联合最优的稀疏系数。该方法确保每个预测可分解为命名且不重叠规则贡献的代数和,天生具备完整可审计性。在十二个临床领域二分类基准上,通过重复分层5折交叉验证的实证评估表明,RPTE性能媲美调优的黑箱集成与可解释基线。相比XGBoost,RPTE将模型检查单元减少9至87倍,且在所有12个数据集上审计复杂度低于EBM。RuleFit在三个规则数少的数据集上具有可比或更少检查单元,但缺乏源不交集保证。源代码见https://github.com/srikumar2050/hugiml-core。
原文摘要 · Abstract (English)
Predictive models in clinical and regulated settings must be accurate and fully auditable. Tree ensembles deliver strong accuracy on tabular data, but their sequential boosting couples structure discovery with coefficient estimation, making compact per-prediction auditing difficult. Interpretable alternatives impose structural constraints that limit expressiveness: generalized additive models typically restrict interactions to pairwise terms and post-hoc rule extractors produce overlapping rules that hinder compact interpretation. We introduce Residual Pattern Tree Ensemble (RPTE), a three-stage learning approach, that is built on three key principles: bounded feature budget, source disjointness, and separate coefficient estimation. Stage~1 builds a supervised symbolic feature vocabulary. Stage~2 grows shallow trees under a source-disjointness constraint, where each raw variable is allocated to at most one tree, and retains only the discovered tree structures. Stage~3 solves a single $\ell_1$-regularized logistic regression over leaf-region indicators, yielding jointly optimal sparse coefficients. This learning approach ensures that every prediction decomposes into an algebraic sum of named, non-overlapping rule contributions, enabling full auditability by design. Empirical evaluation on twelve clinical-domain binary classification benchmarks using repeated stratified 5-fold cross-validation shows that RPTE performs competitively against tuned opaque ensembles and interpretable baselines. RPTE reduces model inspection units by 9$\times$ to 87$\times$ relative to XGBoost and maintains lower audit complexity than EBM on all 12 datasets. RuleFit requires comparable or fewer inspection units on three datasets where its rule count is small, but without source-disjointness guarantees. The source code is available at \href{https://github.com/srikumar2050/hugiml-core}{this https URL}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。