针对回归数据不平衡问题,提出基于局部分布的自适应过采样方法
Local distribution-based adaptive oversampling for imbalanced regression
- 不划分样本稀疏/常见,而是分解为多个局部分布建模
- 在45个数据集上优于现有方法,尤其提升稀有值预测精度
- 适合处理连续目标变量分布偏斜的回归任务
当连续目标变量分布倾斜时,会形成难以准确预测的稀疏区域,这对机器学习模型构成挑战,尤其影响神经网络性能。与分类任务中的类别不平衡研究相比,回归中的不平衡问题仍相对未被充分探索,现有方法常依赖任意阈值将样本划分为稀有或频繁,忽略了目标分布的连续性,导致生成样本无效甚至丢失重要信息。为此,我们提出LDAO(基于局部分布的自适应过采样),一种新型数据级方法:不将单个样本分类为稀有或频繁,而是通过将数据集分解为多个局部分布的混合,保持各局部的统计特征。随后独立建模并采样每个局部分布,最后合并成平衡训练集。该方法在全目标范围内实现均衡表示,同时保留局部分布的内在结构。在45个不平衡数据集上的广泛评估表明,LDAO在频繁和稀有目标值上均优于当前最优过采样方法,有效应对回归不平衡挑战。
原文摘要 · Abstract (English)
Imbalanced regression occurs when continuous target variables have skewed distributions, creating sparse regions that are difficult for machine learning models to predict accurately. This issue particularly affects neural networks, which often struggle with imbalanced data. While class imbalance in classification has been extensively studied, imbalanced regression remains relatively unexplored, with few effective solutions. Existing approaches often rely on arbitrary thresholds to categorize samples as rare or frequent, ignoring the continuous nature of target distributions. These methods can produce synthetic samples that fail to improve model performance and may discard valuable information through undersampling. To address these limitations, we propose LDAO (Local Distribution-based Adaptive Oversampling), a novel data-level approach that avoids categorizing individual samples as rare or frequent. Instead, LDAO learns the global distribution structure by decomposing the dataset into a mixture of local distributions, each preserving its statistical characteristics. LDAO then models and samples from each local distribution independently before merging them into a balanced training set. LDAO achieves a balanced representation across the entire target range while preserving the inherent statistical structure within each local distribution. In extensive evaluations on 45 imbalanced datasets, LDAO outperforms state-of-the-art oversampling methods on both frequent and rare target values, demonstrating its effectiveness for addressing the challenge of imbalanced regression.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。