EDCA通过进化算法优化数据处理,用更少数据实现高效机器学习
EDCA - An Evolutionary Data-Centric AutoML Framework for Efficient Pipelines
- 用进化算法自动优化数据清洗与缩减,构建高效机器学习流水线
- 在相同数据集上性能媲美FLAML和TPOT,但训练数据量显著减少
- 适合关注绿色计算、数据效率的机器学习实践者
自动化机器学习(AutoML)因对机器学习专家的需求增长而兴起,使用户能快速简便地应用机器学习技术。现有AutoML主要聚焦模型选择与超参数调优,却常忽略数据质量这一关键环节,导致数据预处理仍依赖人工且耗时。本文提出EDCA——一种面向数据的进化式AutoML框架,在传统模型与超参优化基础上,引入数据处理任务(如数据缩减与清洗)的自动优化。整个流程由进化算法驱动,生成最优机器学习流水线。在AMLB分类基准数据集上,与顶尖框架FLAML和TPOT对比,EDCA在性能上达到统计等效,但训练所需数据量显著更低。实验表明,结合高效算法与精简数据,可实现高性能且符合绿色AutoML原则的解决方案。
原文摘要 · Abstract (English)
Automated Machine Learning (AutoML) gained popularity due to the increased demand for Machine Learning (ML) specialists, allowing them to apply ML techniques effortlessly and quickly. AutoML implementations use optimisation methods to identify the most effective ML solution for a given dataset, aiming to improve one or more predefined metrics. However, most implementations focus on model selection and hyperparameter tuning. Despite being an important factor in obtaining high-performance ML systems, data quality is usually an overlooked part of AutoML and continues to be a manual and time-consuming task. This work presents EDCA, an Evolutionary Data Centric AutoML framework. In addition to the traditional tasks such as selecting the best models and hyperparameters, EDCA enhances the given data by optimising data processing tasks such as data reduction and cleaning according to the problems' needs. All these steps create an ML pipeline that is optimised by an evolutionary algorithm. To assess its effectiveness, EDCA was compared to FLAML and TPOT, two frameworks at the top of the AutoML benchmarks. The frameworks were evaluated in the same conditions using datasets from AMLB classification benchmarks. EDCA achieved statistically similar results in performance to FLAML and TPOT but used significantly less data to train the final solutions. Moreover, EDCA experimental results reveal that a good performance can be achieved using less data and efficient ML algorithm aspects that align with Green AutoML guidelines
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。