动态调整数据重采样比例,让模型自动关注难分类的类别。
ART: Adaptive Resampling-based Training for Imbalanced Classification
- 根据模型在各类别上的宏F1分数,周期性调整训练数据分布。
- 在表格数据上平均提升宏F1 2.64个百分点,显著优于传统方法。
- 适合各类不平衡分类任务,尤其适用于对泛化性要求高的场景。
处理类别不平衡的传统重采样方法通常采用固定分布,对多数类进行欠采样或对少数类进行过采样。这类静态策略忽略了类别学习难度的变化,限制了模型整体性能。本文提出自适应重采样训练(ART),根据模型在固定间隔下的类别宏F1分数,周期性更新训练数据分布。与基于实例难度的建模相比,ART在类别层面进行适应,避免噪声和异常值干扰。该方法使模型逐步将注意力转向表现较差的类别,更契合优化目标。在多种基准测试中,包括Pima Indians Diabetes和Yeast数据集,ART在二分类和多分类任务中均显著优于基于重采样的方法(如SMOTE、NearMiss)和算法级方法(如代价敏感学习)。在表格数据上,其性能在配对t检验和威尔科克斯检验中均达到统计显著性(p < 0.05);文本与图像任务也表现良好。相比原始不平衡数据训练,ART在所有测试的表格数据上平均提升宏F1 2.64个百分点。与其他方法表现随任务波动不同,ART始终提供最强的宏F1,具备高度可靠性。
原文摘要 · Abstract (English)
Traditional resampling methods for handling class imbalance typically uses fixed distributions, undersampling the majority or oversampling the minority. These static strategies ignore changes in class-wise learning difficulty, which can limit the overall performance of the model. This paper proposes an Adaptive Resampling-based Training (ART) method that periodically updates the distribution of the training data based on the class-wise performance of the model. Specifically, ART uses class-wise macro F1 scores, computed at fixed intervals, to determine the degree of resampling to be performed. Unlike instance-level difficulty modeling, which is noisy and outlier-sensitive, ART adapts at the class level. This allows the model to incrementally shift its attention towards underperforming classes in a way that better aligns with the optimization objective. Results on diverse benchmarks, including Pima Indians Diabetes and Yeast dataset demonstrate that ART consistently outperforms both resampling-based and algorithm-level methods, including Synthetic Minority Oversampling Technique (SMOTE), NearMiss Undersampling, and Cost-sensitive Learning on binary as well as multi-class classification tasks with varying degrees of imbalance. In most settings, these improvements are statistically significant. On tabular datasets, gains are significant under paired t-tests and Wilcoxon tests (p < 0.05), while results on text and image tasks remain favorable. Compared to training on the original imbalanced data, ART improves macro F1 by an average of 2.64 percentage points across all tested tabular datasets. Unlike existing methods, whose performance varies by task, ART consistently delivers the strongest macro F1, making it a reliable choice for imbalanced classification.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。