测试AutoML在脏类别数据上的表现,提出改进编码管道提升效果
Robustness of AutoML on Dirty Categorical Data
- 用先进编码将脏类别数据转为数值,让AutoML更好处理
- 对比发现新管道显著提升预测性能,尤其在高基数类别上
- 适合关注数据预处理与AutoML兼容性的研究者和工程师
自动化机器学习(AutoML)旨在减少机器学习中的试错成本。尽管现有的分类AutoML方法能应对异常值、多尺度和缺失数据等数据缺陷,但其在脏类别数据上的表现仍不明确。这类数据常包含因缺乏整理和自动采集导致的高基数类别特征。近期研究表明,使用形态编码器可显著提升模型对脏类别数据的预测性能。然而,这些编码器在AutoML中的影响尚不清楚。本文提出一种新流程,将类别数据通过更先进的编码方式转化为数值数据,使AutoML能有效处理。我们在一组脏数据集上评估了当前AutoML的鲁棒性,并与所提流程进行对比,揭示了预测性能差异。同时分析AutoML构建的机器学习流水线,获得超越最优模型本身的价值洞察。
原文摘要 · Abstract (English)
The goal of automated machine learning (AutoML) is to reduce trial and error when doing machine learning (ML). Although AutoML methods for classification are able to deal with data imperfections, such as outliers, multiple scales and missing data, their behavior is less known on dirty categorical datasets. These datasets often have several categorical features with high cardinality arising from issues such as lack of curation and automated collection. Recent research has shown that ML models can benefit from morphological encoders for dirty categorical data, leading to significantly superior predictive performance. However the effects of using such encoders in AutoML methods are not known at the moment. In this paper, we propose a pipeline that transforms categorical data into numerical data so that an AutoML can handle categorical data transformed by more advanced encoding schemes. We benchmark the current robustness of AutoML methods on a set of dirty datasets and compare it with the proposed pipeline. This allows us to get insight on differences in predictive performance. We also look at the ML pipelines built by AutoMLs in order to gain insight beyond the best model as typically returned by these methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。