arXiv:2505.04139cs.LG2025-05

LHT用统计方法直接生成可解释的斜向决策树,无需迭代优化。

LHT: Statistically-Driven Oblique Decision Trees for Interpretable Classification

  • 基于类别间特征期望差直接计算分割超平面,非迭代
  • 深度d的树构建时间复杂度为O(mnd),效率高
  • 每层分裂显式给出特征权重,模型可解释性强

我们提出学习超平面树(LHT),一种新型斜向决策树模型,用于表达性强且可解释的分类任务。LHT通过非迭代、基于统计的方法构建分割超平面,直接计算由节点内各类别特征期望差异决定的特征权重,实现确定性超平面构造。预测采用叶节点内的局部最小二乘拟合得到的分段线性隶属函数。我们形式化分析了分割过程的收敛性,确保每次分裂产生有意义的非空子集。同时证明,在深度d下构建LHT的时间复杂度为O(mnd),表明该方法在实践中可行。每个分裂的显式特征权重赋予模型天然可解释性。在基准数据集上的实验表明,LHT具备竞争力的准确率,是树模型中理论扎实、可解释性强且实用的替代方案。代码已开源:https://github.com/Hongyi-Li-sz/LHT_model。

原文摘要 · Abstract (English)

We introduce the Learning Hyperplane Tree (LHT), a novel oblique decision tree model designed for expressive and interpretable classification. LHT fundamentally distinguishes itself through a non-iterative, statistically-driven approach to constructing splitting hyperplanes. Unlike methods that rely on iterative optimization or heuristics, LHT directly computes the hyperplane parameters, which are derived from feature weights based on the differences in feature expectations between classes within each node. This deterministic mechanism enables a direct and well-defined hyperplane construction process. Predictions leverage a unique piecewise linear membership function within leaf nodes, obtained via local least-squares fitting. We formally analyze the convergence of the LHT splitting process, ensuring that each split yields meaningful, non-empty partitions. Furthermore, we establish that the time complexity for building an LHT up to depth $d$ is $O(mnd)$, demonstrating the practical feasibility of constructing trees with powerful oblique splits using this methodology. The explicit feature weighting at each split provides inherent interpretability. Experimental results on benchmark datasets demonstrate LHT's competitive accuracy, positioning it as a practical, theoretically grounded, and interpretable alternative in the landscape of tree-based models. The implementation of the proposed method is available at https://github.com/Hongyi-Li-sz/LHT_model.

决策树可解释性斜向划分统计建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。