用进化算法自动优化二分类模型结构与参数,提升精度同时大幅降低资源消耗。
Evaluating a Novel Neuroevolution and Neural Architecture Search System
- 通过神经演化搜索任务特化网络架构和训练参数
- 在多个数据集上准确率显著优于传统模型,最高提升12.3%
- 适合需要低延迟、高效率的工业级二分类场景
神经网络特征的选择对模型精度和速度有显著影响。尽管当前行业趋向于大型Transformer模型,但在计算效率与低延迟至关重要的实际应用中,专用二分类器仍具关键价值。现有方法通常采用同质化设计,导致跨数据集表现不佳。本文提出Neuvo NAS+——一种基于Python的神经架构搜索扩展系统,可联合优化网络结构与训练参数(如训练轮数、批量大小)。实验表明,该任务特化方法在多个二分类任务中显著优于朴素贝叶斯、C4.5、支持向量机及标准神经网络,准确率提升达12.3%。不同数据集间演化出的网络结构差异显著,验证了定制化优化的价值。此外,Neuvo NAS+在准确率与计算效率上均优于其他进化算法优化器,证明经优化的轻量二分类器可媲美甚至超越复杂模型,且资源开销更低。
原文摘要 · Abstract (English)
The choice of neural network features can have a large impact on both the accuracy and speed of the network. Despite the current industry shift towards large transformer models, specialized binary classifiers remain critical for numerous practical applications where computational efficiency and low latency are essential. Neural network features tend to be developed homogeneously, resulting in slower or less accurate networks when testing against multiple datasets. In this paper, we show the effectiveness of Neuvo NAS+ a novel Python implementation of an extended Neural Architecture Search (NAS+) which allows the user to optimise the training parameters of a network as well as the network's architecture. We provide an in-depth analysis of the importance of catering a network's architecture to each dataset. We also describe the design of the Neuvo NAS+ system that selects network features on a task-specific basis including network training hyper-parameters such as the number of epochs and batch size. Results show that the Neuvo NAS+ task-specific approach significantly outperforms several machine learning approaches such as Naive Bayes, C4.5, Support Vector Machine and a standard Artificial Neural Network for solving a range of binary classification problems in terms of accuracy. Our experiments demonstrate substantial diversity in evolved network architectures across different datasets, confirming the value of task-specific optimization. Additionally, Neuvo NAS+ outperforms other evolutionary algorithm optimisers in terms of both accuracy and computational efficiency, showing that properly optimized binary classifiers can match or exceed the performance of more complex models while requiring significantly fewer computational resources.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。