arXiv:2607.20173cs.LG2026-07中稿 · the 2026 Internati…

用学习难度识别回归中的罕见样本,提升不平衡数据预测效果。

Instance Hardness-Based Relevance for Imbalanced Regression

论文配图:Instance Hardness-Based Relevance for Imbalanced Regression
图 1 · 摘自论文原文
  • 基于实例学习难度定义稀有性,不依赖固定目标值划分。
  • 在双峰分布下显著提升罕见区域识别准确率。
  • 适合处理目标变量分布不均的回归任务,如医疗或金融预测。

当目标变量呈现非对称分布时,回归问题会因某些取值范围样本过少而出现不平衡现象。传统方法依赖预设的相关性函数为特定目标区间分配高权重,但其有效性取决于相关性定义方式。在双峰分布等复杂场景中,仅依据目标值设定固定权重难以区分真正罕见与普通实例。为此,本文提出一种基于实例难度的相关性函数(InHaR),将学习难度纳入考量,使稀有性判断不仅基于目标分布,还结合模型学习困难程度。该方法在双峰分布下能准确识别罕见区域,配合随机过采样(RO)和高斯噪声(GN)等重采样策略,显著优于传统相关性方法。代码、数据集及详细信息已公开于 https://github.com/VitorLeitao/instance-hardness-Imbalanced-regression。

原文摘要 · Abstract (English)

Imbalanced regression problems arise when the target variable has an asymmetric distribution, resulting in underrepresented value ranges in the dataset. Traditional approaches for identifying rare instances rely on a relevance function that assigns higher importance to specific regions of the target distribution. However, the effectiveness of imbalance-aware learning methods depends strongly on how relevance is defined. In more complex scenarios, such as bimodal distributions, traditional relevance functions struggle to capture rarity, as they assign fixed relevance values based solely on target values, thereby compromising the distinction between truly rare and normal instances. To address these limitations, this study proposes an Instance Hardness-based relevance function (InHaR) for identifying rare instances in regression problems. Unlike traditional relevance functions, the proposed approach incorporates learning difficulty, allowing rarity to be inferred not only from the target distribution but also from the difficulty of instances for the learning algorithm. This property is particularly important in bimodal scenarios, where rarity cannot be accurately inferred from target values alone. Experimental results demonstrate that the InHaR correctly identifies rare regions under bimodal distributions and, when used to guide resampling strategies such as Random Oversampling (RO) and Gaussian Noise (GN), leads to significant improvements in predictive performance compared to traditional relevance-based approaches. The code, dataset, and further details about the proposed method are publicly available at https://github.com/VitorLeitao/instance-hardness-Imbalanced-regression.

回归分析不平衡数据实例难度

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。