Extreme AutoML在分类任务中比Google AutoML更快更准。
Extreme AutoML: Analysis of Classification, Regression, and NLP Performance
- 用极端学习机架构实现自动化调参,计算成本更低。
- 在多个UCI数据集上准确率更高,训练时间减少超50%。
- 适合需要快速部署、资源受限的机器学习应用。
使用机器学习技术始终需要选择超参数,无论是传统方法如KNN,还是现代神经网络如深度学习。尽管许多应用仍采用人工调参,自动化方法正日益普及,统称为自动化机器学习(AutoML)。已有多种自动化算法表现优于或媲美顶尖方法。这一突破催生了Google AutoML等云服务,基于深度学习,被公认为行业领导者。极端学习机(ELM)采用根本不同的神经网络结构,在显著降低计算成本的同时表现更优。本文在多个来自加州大学欧文分校(UCI)数据集及其他数据集上,将Extreme AutoML与Google AutoML进行对比,结果显示Extreme AutoML在准确率、杰卡德指数、各类别间杰卡德指数方差(即类别方差)以及训练时间方面均具有显著优势。
原文摘要 · Abstract (English)
Utilizing machine learning techniques has always required choosing hyperparameters. This is true whether one uses a classical technique such as a KNN or very modern neural networks such as Deep Learning. Though in many applications, hyperparameters are chosen by hand, automated methods have become increasingly more common. These automated methods have become collectively known as automated machine learning, or AutoML. Several automated selection algorithms have shown similar or improved performance over state-of-the-art methods. This breakthrough has led to the development of cloud-based services like Google AutoML, which is based on Deep Learning and is widely considered to be the industry leader in AutoML services. Extreme Learning Machines (ELMs) use a fundamentally different type of neural architecture, producing better results at a significantly discounted computational cost. We benchmark the Extreme AutoML technology against Google's AutoML using several popular classification data sets from the University of California at Irvine's (UCI) repository, and several other data sets, observing significant advantages for Extreme AutoML in accuracy, Jaccard Indices, the variance of Jaccard Indices across classes (i.e. class variance) and training times.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。