提出新方法ADABORD,更好利用分类等级信息提升准确率
ADABORD: a novel AdaBoost approach for ordinal classification
- 用带等级分裂准则的决策树做基学习器
- 在五类以上数据集上显著优于七种先进方法
- 适合需要处理有序分类的任务研究者使用
有序分类(OC)处理类别具有自然顺序的分类任务。尽管已有进展,许多现有方法未能充分利用等级信息,将问题视为无序分类,从而损失性能潜力。本文提出专为有序分类设计的AdaBoost框架ADABORD,将等级特性融入经典AdaBoost算法的两个关键组件:1)基学习器采用带有等级Gini分裂准则的决策树;2)误差函数采用绝对排名概率得分(absolute ranked probability score),该度量同时考虑类别顺序与距离,用于更新样本权重和集成模型中分类器权重。ADABORD在当前最大的有序分类基准库TOC-UCO上与七种先进方法进行广泛比较。实验结果经统计分析验证,表明ADABORD显著优于对比方法,尤其在五类及以上数据集上表现更优,此时等级结构更为明显。源代码及所有实验协议均已公开,以保障可复现性并促进未来研究。
原文摘要 · Abstract (English)
Ordinal Classification (OC) deals with classification tasks where the classes follow a natural order. Despite the progress in OC, many existing approaches fail to fully leverage the ordinal information, treating the problem as nominal classification and thereby losing performance potential. In this work, ADABORD, an AdaBoost framework specifically designed for ordinal classification problems, is introduced. The ordinal nature of the classes is incorporated into two key components of the well-known AdaBoost algorithm: 1) the base estimator, where decision trees with the ordinal Gini splitting criterion are proposed; 2) the error function used to update sample weights at each stage and the weights of the classifier in the final ensemble model, given by the absolute ranked probability score, a measure that accounts for both the ordering and the distance between classes. ADABORD is extensively compared against seven state-of-the-art methods on the TOC-UCO repository, the largest benchmark collection for OC to date. The experimental results, supported by statistical analysis, show that ADABORD significantly outperforms competing methods, particularly on datasets with five or more classes, where the ordinal structure becomes more pronounced. Source code, along with all experimental protocols, is publicly available to ensure reproducibility and facilitate future research in OC.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。