arXiv:2503.19306stat.MLcs.LG2025-03被引 2

用类中心驱动分裂,提升高维分类的准确率与鲁棒性

Centroid Decision Forest

  • 基于类中心可分性评分选择关键特征,构建分割类中心
  • 在23个高维数据集上超越主流方法,准确率与一致性指标双优
  • 兼顾可解释性与扩展性,适合高维结构复杂的数据分析

本文提出一种新型集成学习框架——中心决策森林(CDF),用于高维分类任务。其核心在于重构传统决策树的分裂策略:在每个节点,通过类可分性得分(CSS)选择最具判别性的特征,计算各分类的特征均值以构建类中心,再依据类中心间的欧氏距离实现灵活且稳健的分割。该中心驱动机制能有效捕捉复杂类别结构,同时保持模型可解释性与可扩展性。在23个高维数据集上的实验表明,CDF在分类准确率和Cohen's kappa统计量上均优于多种先进分类器,验证了其在高维分类中的有效性与适应性。

原文摘要 · Abstract (English)

This paper introduces the centroid decision forest (CDF), a novel ensemble learning framework that redefines the splitting strategy and tree building in the ordinary decision trees for high-dimensional classification. The splitting approach in CDF differs from the traditional decision trees in theat the class separability score (CSS) determines the selection of the most discriminative features at each node to construct centroids of the partitions (daughter nodes). The splitting criterion uses the Euclidean distance measurements from each class centroid to achieve a splitting mechanism that is more flexible and robust. Centroids are constructed by computing the mean feature values of the selected features for each class, ensuring a class-representative division of the feature space. This centroid-driven approach enables CDF to capture complex class structures while maintaining interpretability and scalability. To evaluate CDF, 23 high-dimensional datasets are used to assess its performance against different state-of-the-art classifiers through classification accuracy and Cohen's kappa statistic. The experimental results show that CDF outperforms the conventional methods establishing its effectiveness and flexibility for high-dimensional classification problems.

决策森林高维分类特征选择可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。