arXiv:2509.01943cs.LGcs.AI2025-09被引 1

用连续编码降低搜索维度,高效优化多目标神经网络结构。

A Continuous Encoding-Based Representation for Efficient Multi-Fidelity Multi-Objective Neural Architecture Search

  • 提出连续编码表示细胞连接,减少搜索变量数
  • 在有限算力下超越现有最优方法,提升收敛速度
  • 适用于城市风速预测等实际场景,可复现经典设计原则

神经架构搜索(NAS)虽能自动化设计高性能模型,但受限于高计算成本,尤其在多目标冲突优化时。为此,本文提出一种基于自适应协克里金的多保真度多目标NAS算法,结合聚类驱动的局部多保真度采样策略,加速搜索空间探索。通过引入新型连续编码方法,表示通用单元化U-Net骨干网络中各细胞的连接关系,显著降低搜索维度。在三个数值基准、二维达西渗流回归问题和CHASE_DB1生物医学图像分割任务上,该方法在有限计算预算下均优于先前最先进方法。进一步应用于城市建模中的风速回归建模,所发现模型以更低复杂度实现良好预测性能。分析还表明,该算法独立发现了文献中已知的优秀U-Net架构设计原则,如允许每层细胞融合前序信息。

原文摘要 · Abstract (English)

Neural architecture search (NAS) is an attractive approach to automate the design of optimized architectures but is constrained by high computational budget, especially when optimizing for multiple, important conflicting objectives. To address this, an adaptive Co-Kriging-assisted multi-fidelity multi-objective NAS algorithm is proposed to further reduce the computational cost of NAS by incorporating a clustering-based local multi-fidelity infill sampling strategy, enabling efficient exploration of the search space for faster convergence. This algorithm is further accelerated by the use of a novel continuous encoding method to represent the connections of nodes in each cell within a generalized cell-based U-Net backbone, thereby decreasing the search dimension (number of variables). Results indicate that the proposed NAS algorithm outperforms previously published state-of-the-art methods under limited computational budget on three numerical benchmarks, a 2D Darcy flow regression problem and a CHASE_DB1 biomedical image segmentation problem. The proposed method is subsequently used to create a wind velocity regression model with application in urban modelling, with the found model able to achieve good prediction with less computational complexity. Further analysis revealed that the NAS algorithm independently identified principles undergirding superior U-Net architectures in other literature, such as the importance of allowing each cell to incorporate information from prior cells.

神经架构搜索多目标优化连续编码高效建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。