对比了有序决策树的分裂准则,发现新方法能显著降低误差。
Splitting criteria for ordinal decision trees: an experimental study
- 提出三种有序分裂准则并对比其效果
- 新准则使平均绝对误差比传统方法低超3.02%
- 适合关注排序分类精度的研究者与应用开发者
有序分类(OC)处理标签具有天然顺序的分类任务。与将类别视为无序互斥的名义分类不同,有序分类考虑类别间的顺序关系,可提升结果准确性和相关性,尤其在错误代价敏感的应用中至关重要。尽管如此,现有方法仍常使用名义分类器处理有序问题,导致次优解。虽然决策树是主流分类方法之一,但针对有序分类的树模型研究较少。本文系统综述了有序分裂准则,统一文献中的符号表达以增强清晰性。将三种有序分裂准则(有序基尼、加权信息增益、排序不纯度)与对应的名义准则(基尼、信息增益)进行对比,嵌入决策树分类器中。构建了涵盖45个公开可用的有序分类数据集的实验库,首次基于经典评价指标对有序与名义分裂准则进行系统性实验比较。统计分析表明,有序基尼(OGini)为当前最优的有序分裂准则,其平均绝对误差较基尼准则降低超过3.02%。为保障可复现性,所有源代码、复现指南、45个数据集及各方法个体结果均已公开。
原文摘要 · Abstract (English)
Ordinal Classification (OC) addresses those classification tasks where the labels exhibit a natural order. Unlike nominal classification, which treats all classes as mutually exclusive and unordered, OC takes the ordinal relationship into account, producing more accurate and relevant results. This is particularly critical in applications where the magnitude of classification errors has significant consequences. Despite this, OC problems are often tackled using nominal methods, leading to suboptimal solutions. Although decision trees are among the most popular classification approaches, ordinal tree-based approaches have received less attention when compared to other classifiers. This work provides a comprehensive survey of ordinal splitting criteria, standardising the notations used in the literature to enhance clarity and consistency. Three ordinal splitting criteria, Ordinal Gini (OGini), Weighted Information Gain (WIG), and Ranking Impurity (RI), are compared to the nominal counterparts of the first two (Gini and information gain), by incorporating them into a decision tree classifier. An extensive repository considering $45$ publicly available OC datasets is presented, supporting the first experimental comparison of ordinal and nominal splitting criteria using well-known OC evaluation metrics. The results have been statistically analysed, highlighting that OGini stands out as the best ordinal splitting criterion to date, reducing the mean absolute error achieved by Gini by more than 3.02%. To promote reproducibility, all source code developed, a detailed guide for reproducing the results, the 45 OC datasets, and the individual results for all the evaluated methodologies are provided.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。