arXiv:2606.01221cs.LGcs.AI2026-06中稿 · Expert Systems wit…被引 1

提出统一框架,同时优化数据和算法层面的不平衡回归问题。

Hybrid Imbalanced Regression Through Unified Data-Level and Algorithm-Level Balancing

论文配图:Hybrid Imbalanced Regression Through Unified Data-Level and Algorithm-Level Balancing
图 1 · 摘自论文原文
  • 动态划分目标空间,结合条件变分自编码器学习特征表示。
  • 通过聚类过采样与新型损失函数,显著提升稀有样本预测精度。
  • 适用于复杂分布的回归任务,尤其适合数据稀疏场景。

不平衡学习是机器学习中的关键挑战,低频目标值会导致模型偏差并降低对重要但罕见案例的预测性能。尽管分类任务中已有广泛研究,不平衡回归仍相对未被充分探索。现有方法多集中于数据层面平衡(易引入噪声和过拟合)或算法层面平衡(在复杂目标分布下表现不佳)。为此,本文提出一种统一的混合框架,将数据与算法层面平衡策略整合为一个无需依赖特定回归器的通用流程。该框架包含五个阶段:(1) 基于局部线性一致性的自适应箱体划分;(2) 使用条件变分自编码器进行目标条件表征学习;(3) 通过特征空间聚类与少数簇过采样实现多阶段数据层面平衡;(4) 采用新颖的潜在密度加权损失(LDWL)在潜在空间和目标空间中强化稀有样本;(5) 利用注意力门控融合生成最终回归结果。在基准数据集上的实验表明,该框架在预测性能上持续优于单一回归器及现有不平衡回归方法。

原文摘要 · Abstract (English)

Imbalanced learning is a critical challenge in machine learning, where underrepresented target values can bias models and degrade prediction performance on rare but important cases. Although extensively studied in classification, imbalanced regression remains relatively underexplored. Existing methods mainly focus on either data-level balancing, which may introduce noise and overfitting, or algorithm-level balancing, which often struggles with highly complex target distributions. To address these limitations, we propose a unified hybrid framework that integrates both data- and algorithm-level balancing strategies into a regressor-agnostic pipeline. The proposed framework consists of five stages: (1) adaptive bin partitioning to dynamically segment the target space based on local linear coherence; (2) target-conditioned representation learning using a Conditional Variational Autoencoder; (3) multistage data-level balancing through feature-space clustering and oversampling of minority clusters; (4) algorithm-level balancing using a novel Latent-Density Weighted Loss (LDWL) to emphasize rare samples in latent and target spaces; and (5) attention-based gated fusion for final regression. Experimental results on benchmark datasets demonstrate that the proposed framework consistently improves predictive performance compared to standalone regressors and existing imbalanced regression approaches.

不平衡回归数据平衡深度学习损失函数

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。