用进化算法自动发现小而强的序列模型,跨任务通用且参数大幅减少。
Seq103: A Unified Neuroevolution Framework for Compact Sequence Architecture Discovery
- 统一框架+可选记忆机制,适配循环与前馈序列任务
- 平均保留86.96%基准准确率,参数量减少34.6到3218倍
- 适合资源受限场景下的轻量级序列建模研究者
神经进化是一种通过进化算法同时优化网络结构与权重的神经架构搜索范式。本文提出Seq103,一种基于NEAT风格的统一神经进化框架,用于紧凑序列架构发现。该框架包含共享的进化主干与可选的递归扩展。共享主干包括节点与连接的基本表示、基于类别的均方误差评估、基于类别的重组突变策略及精英保留机制。可选的隐藏状态机制引入隐藏状态节点与连接,实现步进递归推理时的时间记忆能力。在此设计下,Seq103对步进递归与样本前馈序列分类任务采用相同的搜索流程:在递归任务中启用隐藏状态扩展以提供时序记忆;在前馈任务中禁用该扩展,仅使用共享主干。我们在8个文本分类数据集和包含128个单变量时间序列的UCRArchive2018完整基准上进行了评估。在步进任务中,平均保留86.96%的最优基线准确率,参数量减少34.6至3218.0倍;在全UCRArchive2018上的样本前馈任务中,平均保留81.95%的最优基线准确率,参数量减少11.8至160,601.0倍。
原文摘要 · Abstract (English)
Neuroevolution is a representative neural architecture search paradigm that evolves both network topology and weights through evolutionary algorithms. In this paper, we propose Seq103, a unified NEAT-style neuroevolution framework for compact sequence architecture discovery. Seq103 consists of a shared evolutionary backbone and an optional recurrent extension. The shared backbone includes an elementary node-and-connection representation, per-class RMSE-based evaluation, mutation-based evolution with class-wise recombination, and elitism. The optional hidden-state mechanism extends the search space with hidden-state nodes and hidden connections, enabling temporal memory when step-wise recurrent inference is required. With this design, Seq103 applies the same core search pipeline to both step-wise recurrent and sample-wise feedforward sequence classification. In recurrent tasks, the hidden-state extension is enabled to provide temporal memory; in feedforward tasks, it is disabled while the shared evolutionary backbone remains unchanged. We evaluate Seq103 on 8 text classification datasets and the full UCRArchive2018 benchmark with 128 univariate time-series datasets. On step-wise tasks, Seq103 retains 86.96% of the best-baseline accuracy on average while using 34.6x to 3218.0x fewer parameters. On sample-wise tasks over the full UCRArchive2018 benchmark, Seq103 retains 81.95% of the best-baseline accuracy on average while using 11.8x to 160,601.0x fewer parameters.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。