arXiv:2504.06207cs.LGcs.AI2025-04综述被引 4

用400数据集评估8种算法选择方法,助力自动调参落地

An experimental survey and Perspective View on Meta-Learning for Automated Algorithms Selection and Parametrization

  • 构建400万模型知识库,统一评估不同元学习算法选择方案
  • 在400个基准数据集上验证,量化比较主流方法性能差异
  • 面向缺乏机器学习经验的科研人员,推动自动化建模普及

近年来,针对算法选择与参数化(ASP)问题的研究取得了显著进展,涵盖多种元学习范式。然而,现有研究缺乏对已有方法的系统性综述与对比评估。本文综述了该领域最新进展,阐明通过元学习实现算法选择的动因。自动化机器学习(AutoML)通常被视为一种ASP问题,旨在降低机器学习门槛,使领域科学家能便捷应用高级分析技术,无需手动选择算法或调参。基于对前人工作的梳理,本文提出一个通用框架,系统讨论分类器选择的各个阶段。进一步,构建了一个包含400万已学习模型的基准知识库,并基于8种分类算法和400个基准数据集,对主流算法选择方法进行了广泛比较。该实证研究定量评估了各类方法的性能,揭示了现有研究的优势与局限。

原文摘要 · Abstract (English)

Considerable progress has been made in the recent literature studies to tackle the Algorithms Selection and Parametrization (ASP) problem, which is diversified in multiple meta-learning setups. Yet there is a lack of surveys and comparative evaluations that critically analyze, summarize and assess the performance of existing methods. In this paper, we provide an overview of the state of the art in this continuously evolving field. The survey sheds light on the motivational reasons for pursuing classifiers selection through meta-learning. In this regard, Automated Machine Learning (AutoML) is usually treated as an ASP problem under the umbrella of the democratization of machine learning. Accordingly, AutoML makes machine learning techniques accessible to domain scientists who are interested in applying advanced analytics but lack the required expertise. It can ease the task of manually selecting ML algorithms and tuning related hyperparameters. We comprehensively discuss the different phases of classifiers selection based on a generic framework that is formed as an outcome of reviewing prior works. Subsequently, we propose a benchmark knowledge base of 4 millions previously learned models and present extensive comparative evaluations of the prominent methods for classifiers selection based on 08 classification algorithms and 400 benchmark datasets. The comparative study quantitatively assesses the performance of algorithms selection methods along while emphasizing the strengths and limitations of existing studies.

元学习AutoML算法选择基准测试

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。