arXiv:2606.18853stat.MLcs.LG2026-06

提出统一表示框架KPP,让树模型的预测与解释更连贯。

Kernel of Partition Paths: A Unified Representation for Tree Ensembles

  • 用节点路径加权构建统一特征表示,替代传统分裂点表示。
  • 在该表示下实现精确可加性归因与确定性鲁棒半径保证。
  • 适合关注模型解释性与理论保障的研究者使用。

近期研究将单棵决策树重述为基于分裂特征的线性模型,为泛化界和特征重要性重解释开辟了新路径,但未解决森林整体在以节点而非分裂点索引特征映射时所诱导的统一几何结构问题。本文研究该结构。KPP通过森林节点索引特征映射,并采用路径度量加权,使每个坐标成为平方欧氏路径等距嵌入的一部分。KPP在单一节点索引表示下统一了四大支柱:预测、精确可加归因、在KPP度量下的确定性Lipschitz鲁棒半径,以及在固定、诚实或交叉拟合条件下的回归与分类统一Rademacher风险界。所有概率保证均基于该表示,并在三种显式条件设定下陈述;鲁棒半径保证为确定性,而非原始输入上的范数。回归与分类的快速率改进被列为开放问题,未作为定理声明。

原文摘要 · Abstract (English)

A recent line of work has reframed individual decision trees as linear models on engineered features associated with their splits, opening routes for oracle inequalities and feature-importance reinterpretation, but leaving open the question of what unified geometric object a forest induces when one indexes its feature map by nodes rather than by splits. The present paper studies that object. KPP indexes the feature map by the nodes of the forest, weighted by a path metric that turns each coordinate into a component of a squared-Euclidean path-isometric embedding. KPP unifies four pillars under a single node-indexed representation whose Gram is non-diagonal and carries a metric: prediction, exact additive attribution, deterministic Lipschitz robust radius in the KPP metric, and uniform Rademacher risk bounds for regression and classification under fixed, honest, or cross-fit conditioning. All probabilistic guarantees are conditional on the representation and are stated under three explicit conditioning regimes; the robust-radius guarantee is deterministic in the KPP metric rather than in a norm on the raw input. Conjectured fast-rate refinements for both regression and classification are stated as open problems and are not claimed as theorems.

树模型可解释性理论分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。