arXiv:2502.20279cs.LG2025-02

实时自动机器学习新方法,快速生成高质量模型设计。

Online Meta-learning for AutoML in Real-time (OnMAR)

  • 用元学习预测模型精度,决定是否采用当前设计
  • 结合遗传算法优化,三类真实场景均表现优异
  • 通用性强,适合需要快速调参的实时应用

自动化机器学习(AutoML)旨在通过优化技术自动设计机器学习算法,减少人工干预。实时AutoML允许在算法运行过程中完成设计。现有方法在设计质量与耗时方面仍有不足。本文提出在线元学习框架OnMAR,通过元特征捕捉优化过程信息,并利用元学习器预测模型精度:若预测达标则直接使用,否则由遗传算法生成新设计。测试了k近邻、随机森林和XGBoost三种元学习器。OnMAR为模型无关方法,在三个真实场景中评估:图像聚类算法组合、卷积神经网络超参数配置、视频分类流水线配置。结果表明其性能匹配或超越现有方法,且运行更快。

原文摘要 · Abstract (English)

Automated machine learning (AutoML) is a research area focusing on using optimisation techniques to design machine learning (ML) algorithms, alleviating the need for a human to perform manual algorithm design. Real-time AutoML enables the design process to happen while the ML algorithm is being applied to a task. Real-time AutoML is an emerging research area, as such existing real-time AutoML techniques need improvement with respect to the quality of designs and time taken to create designs. To address these issues, this study proposes an Online Meta-learning for AutoML in Real-time (OnMAR) approach. Meta-learning gathers information about the optimisation process undertaken by the ML algorithm in the form of meta-features. Meta-features are used in conjunction with a meta-learner to optimise the optimisation process. The OnMAR approach uses a meta-learner to predict the accuracy of an ML design. If the accuracy predicted by the meta-learner is sufficient, the design is used, and if the predicted accuracy is low, an optimisation technique creates a new design. A genetic algorithm (GA) is the optimisation technique used as part of the OnMAR approach. Different meta-learners (k-nearest neighbours, random forest and XGBoost) are tested. The OnMAR approach is model-agnostic (i.e. not specific to a single real-time AutoML application) and therefore evaluated on three different real-time AutoML applications, namely: composing an image clustering algorithm, configuring the hyper-parameters of a convolutional neural network, and configuring a video classification pipeline. The OnMAR approach is effective, matching or outperforming existing real-time AutoML approaches, with the added benefit of a faster runtime.

AutoML元学习实时优化遗传算法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。