arXiv:2507.11901cs.LG2025-07被引 1

用元学习自动推荐最适不平衡回归方案,无需试错。

Imbalanced Regression Pipeline Recommendation

  • 用元特征训练模型,零样本推荐最佳数据处理与算法组合。
  • 在42种配置中表现超越所有基线,尤其链式结构更优。
  • 适合需要快速部署的工业级回归任务,省去调参时间。

不平衡问题广泛存在于现实场景中,虽在分类任务中研究较多,但回归任务同样因目标值稀有而面临挑战。现有方法常通过预处理中的平衡算法缓解,但不同重采样方法与学习模型组合繁多,最优解需大量实验验证。此外,模型、数据集与评估指标均影响最佳策略。本文提出面向不平衡回归的元学习框架 Meta-IR,通过训练元分类器,零样本推荐每项任务的最佳流水线(包括重采样策略与学习模型)。提出独立与链式两种建模方式:独立分别预测最优算法与策略;链式则顺序建模二者内在关联。链式结构表现更佳,表明算法与策略间存在任务相关依赖。相较于AutoML框架及6种算法×6种重采样+无重采样共42种配置的基线,Meta-IR全面优于所有对比方案。代码、数据及实验详情见GitHub:https://github.com/JusciAvelino/Meta-IR。

原文摘要 · Abstract (English)

Imbalanced problems are prevalent in various real-world scenarios and are extensively explored in classification tasks. However, they also present challenges for regression tasks due to the rarity of certain target values. A common alternative is to employ balancing algorithms in preprocessing to address dataset imbalance. However, due to the variety of resampling methods and learning models, determining the optimal solution requires testing many combinations. Furthermore, the learning model, dataset, and evaluation metric affect the best strategies. This work proposes the Meta-learning for Imbalanced Regression (Meta-IR) framework, which diverges from existing literature by training meta-classifiers to recommend the best pipeline composed of the resampling strategy and learning model per task in a zero-shot fashion. The meta-classifiers are trained using a set of meta-features to learn how to map the meta-features to the classes indicating the best pipeline. We propose two formulations: Independent and Chained. Independent trains the meta-classifiers to separately indicate the best learning algorithm and resampling strategy. Chained involves a sequential procedure where the output of one meta-classifier is used as input for another to model intrinsic relationship factors. The Chained scenario showed superior performance, suggesting a relationship between the learning algorithm and the resampling strategy per task. Compared with AutoML frameworks, Meta-IR obtained better results. Moreover, compared with baselines of six learning algorithms and six resampling algorithms plus no resampling, totaling 42 (6 X 7) configurations, Meta-IR outperformed all of them. The code, data, and further information of the experiments can be found on GitHub: https://github.com/JusciAvelino/Meta-IR.

不平衡回归元学习自动化流水线推荐

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。