根据样本难易度动态调整惩罚,提升少数类分类效果
iCost: A Novel Instance-Complexity-Based Cost-Sensitive Learning Framework
- 按样本局部复杂度自适应分配惩罚,而非统一处理少数类
- 在65个二分类和10个多分类数据集上显著优于传统代价敏感方法
- 提供Python工具包,适合需要处理不平衡数据的研究与工程人员
类别不平衡在分类任务中带来严峻挑战,常导致标准学习算法偏向多数类。代价敏感学习(CSL)通过为少数类误分赋予更高惩罚来缓解此问题。然而,传统CSL对所有少数类样本采用统一惩罚,忽略了其在局部安全性、重叠度、边界模糊性和异常值行为等方面的差异。这种均匀惩罚可能引入额外偏差,增加误分类数。本文提出iCost,一种基于实例复杂度的代价敏感学习框架,根据估计的学习难度为少数类样本分配自适应惩罚。该细粒度惩罚策略实现更公平的权重分配,减少不必要偏差,提升整体分类性能。提出两种互补的复杂度估计方法:基于局部邻域组成的Neighbor-iCost,以及基于基尼不纯度特征空间划分的Gini-iCost。在65个二分类和10个多分类不平衡数据集上的大量实验表明,iCost显著优于传统CSL,并在性能上媲美广泛使用的重采样方法。为支持可复现性与实际应用,该算法已作为scikit-learn兼容的Python包通过PyPI发布。本工作通过将实例级数据复杂度融入学习过程,为不平衡学习提供了新视角,开启了开发自适应、复杂度感知分类策略的新路径。
原文摘要 · Abstract (English)
Class imbalance poses a significant challenge in classification tasks, often causing standard learning algorithms to become biased toward the majority class. Cost-sensitive learning (CSL) addresses this issue by assigning higher penalties to minority-class misclassifications. However, conventional CSL typically applies a uniform penalty to all minority-class instances, ignoring the fact that minority samples may differ substantially in terms of local safety, overlap, boundary ambiguity, and outlier-like behavior. Uniform penalization can therefore introduce undue bias, increasing the number of misclassifications. In this study, we propose iCost, an instance-complexity-aware CSL framework that assigns adaptive penalties to minority-class samples according to their estimated learning difficulty. This fine-grained penalization strategy ensures fairer weighting, reduces unwarranted bias, and improves overall classification performance. Two complementary complexity estimation strategies are introduced: Neighbor-iCost, based on local neighborhood composition, and Gini-iCost, based on Gini-impurity-based feature-space partitioning. Extensive experiments on 65 binary and 10 multiclass imbalanced datasets show that iCost outperforms conventional CSL by a clear margin and remains highly competitive with widely used resampling methods. To support reproducibility and practical adoption, the proposed algorithm has been released as a scikit-learn-compatible Python package through PyPI. This work offers a fresh perspective on imbalanced learning by integrating instance-level data complexity into the learning process, opening new avenues for developing adaptive, complexity-aware strategies for imbalanced classification.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。