通过融合多类分布信息,提升小样本类分类精度。
Rebalancing with Calibrated Sub-classes (RCS): A Statistical Fusion-based Framework for Robust Imbalanced Classification across Modalities
- 用高斯混合加权融合主流与中间类分布
- 生成合成样本时引入校准后分布,减少过拟合
- 跨图像、文本、表格数据均有效,适合真实场景
类别不平衡问题在某些类别数据不足时严重影响分类鲁棒性,常导致模型偏向多数类。分布校准为解决此问题提供了新思路。本文提出基于统计融合的稳健不平衡分类框架——校准子类重平衡(RCS)。RCS通过加权高斯成分混合,融合多数类与中间类的统计信息,更准确估计少数类参数。采用编码器-解码器网络保持不平衡数据集中的结构关系,防止特征解耦。训练完成后,利用编码器提取的特征向量,根据校准后的分布生成合成样本。该融合校准策略通过引入邻域分布信息,有效缓解了仅依赖多数类统计带来的过度泛化问题。在多种图像、文本和表格数据集上的大量实验表明,RCS持续优于多个基线及先进方法,展现出强大有效性与广泛适用性,适用于现实世界中的不平衡分类挑战。
原文摘要 · Abstract (English)
Class imbalance, where certain classes have insufficient data, poses a critical challenge for robust classification, often biasing models toward majority classes. Distribution calibration offers a promising avenue to address this by estimating more accurate class distributions. In this work, we propose Rebalancing with Calibrated Sub-classes (RCS) - a novel distribution calibration framework for robust imbalanced classification. RCS aims to fuse statistical information from the majority and intermediate class distributions via a weighted mixture of Gaussian components to estimate minority class parameters more accurately. An encoder-decoder network is trained to preserve structural relationships in imbalanced datasets and prevent feature disentanglement. Post-training, encoder-extracted feature vectors are leveraged to generate synthetic samples guided by the calibrated distributions. This fusion-based calibration effectively mitigates overgeneralization by incorporating neighborhood distribution information rather than relying solely on majority-class statistics. Extensive experiments on diverse image, text, and tabular datasets demonstrate that RCS consistently outperforms several baseline and state-of-the-art methods, highlighting its effectiveness and broad applicability in addressing real-world imbalanced classification challenges.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。