解决多分类不平衡数据中的噪声与重叠问题,提升模型可靠性。
IMOVNO+: A Regional Partitioning and Meta-Heuristic Ensemble Framework for Imbalanced Multi-Class Learning
- 分区域处理数据:识别核心、重叠、噪声区域,精准清理。
- 多分类下G-mean提升37%-57%,二分类接近完美表现。
- 适合数据质量差、样本不均衡的工业场景应用。
类别不平衡、重叠和噪声会降低数据质量,削弱模型可靠性并限制泛化能力。尽管在二分类中已有广泛研究,但在多分类场景下,复杂的类间关系使少数类-多数类结构模糊,传统聚类难以捕捉分布形态。仅依赖几何距离的方法可能误删信息样本并生成低质合成数据,而二值化方法仅局部处理,忽略全局类间依赖。在算法层面,集成学习难以有效整合弱分类器,导致鲁棒性不足。本文提出IMOVNO+(IMbalance-OVerlap-NOise+ Algorithm-Level Optimization),一个两级框架,联合优化数据质量与算法鲁棒性,适用于二分类和多分类任务。数据层:首先用条件概率量化样本信息量;其次将数据集划分为核心、重叠和噪声区域;再次引入结合Z-score与大跳距距离的重叠清洗算法;最后采用基于多正则化的智能过采样,控制合成样本邻近度,防止新重叠产生。算法层:设计元启发式策略剪枝集成分类器,降低弱学习器影响。在35个数据集(13个多分类,22个二分类)上评估,结果持续优于现有方法,多分类场景下G-mean提升37%-57%,F1-score提升25%-44%,精确率提升25%-39%,召回率提升26%-43%;二分类中性能提升14%-39%,接近完美。该框架可应对数据稀缺及隐私限制带来的不平衡问题。
原文摘要 · Abstract (English)
Class imbalance, overlap, and noise degrade data quality, reduce model reliability, and limit generalization. Although widely studied in binary classification, these issues remain underexplored in multi-class settings, where complex inter-class relationships make minority-majority structures unclear and traditional clustering fails to capture distribution shape. Approaches that rely only on geometric distances risk removing informative samples and generating low-quality synthetic data, while binarization approaches treat imbalance locally and ignore global inter-class dependencies. At the algorithmic level, ensembles struggle to integrate weak classifiers, leading to limited robustness. This paper proposes IMOVNO+ (IMbalance-OVerlap-NOise+ Algorithm-Level Optimization), a two-level framework designed to jointly enhance data quality and algorithmic robustness for binary and multi-class tasks. At the data level, first, conditional probability is used to quantify the informativeness of each sample. Second, the dataset is partitioned into core, overlapping, and noisy regions. Third, an overlapping-cleaning algorithm is introduced that combines Z-score metrics with a big-jump gap distance. Fourth, a smart oversampling algorithm based on multi-regularization controls synthetic sample proximity, preventing new overlaps. At the algorithmic level, a meta-heuristic prunes ensemble classifiers to reduce weak-learner influence. IMOVNO+ was evaluated on 35 datasets (13 multi-class, 22 binary). Results show consistent superiority over state-of-the-art methods, approaching 100% in several cases. For multi-class data, IMOVNO+ achieves gains of 37-57% in G-mean, 25-44% in F1-score, 25-39% in precision, and 26-43% in recall. In binary tasks, it attains near-perfect performance with improvements of 14-39%. The framework handles data scarcity and imbalance from collection and privacy limits.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。