arXiv:2504.17827cs.NEcs.AI2025-04

用进化算法优化扩散模型,高效生成最优神经网络结构

Evolution Meets Diffusion: Efficient Neural Architecture Generation

  • 将进化算法融入扩散模型去噪过程,以适应度引导架构生成
  • 精度最高提升10.45%,推理速度加快50倍,无需训练
  • 适合追求高效、免训练的神经网络设计者

神经架构搜索(NAS)在深度学习模型设计中具有变革潜力,但其庞大的搜索空间导致显著的计算和时间开销。神经架构生成(NAG)将其重构为生成问题,可精准生成特定任务的最优架构。尽管前景广阔,主流方法如扩散模型仍存在全局搜索能力不足、计算成本高的问题。为此,我们提出基于进化扩散的神经架构生成方法(EDNAG),实现高效且无需训练的架构生成。EDNAG利用进化算法模拟扩散模型中的去噪过程,以适应度引导从随机高斯分布到最优架构分布的演化。该方法融合进化策略与扩散模型优势,实现快速有效的架构生成。大量实验表明,EDNAG在架构优化上达到当前最优性能,精度最高提升10.45%;同时消除训练需求,平均推理速度提升50倍,展现出卓越的效率与有效性。

原文摘要 · Abstract (English)

Neural Architecture Search (NAS) has gained widespread attention for its transformative potential in deep learning model design. However, the vast and complex search space of NAS leads to significant computational and time costs. Neural Architecture Generation (NAG) addresses this by reframing NAS as a generation problem, enabling the precise generation of optimal architectures for specific tasks. Despite its promise, mainstream methods like diffusion models face limitations in global search capabilities and are still hindered by high computational and time demands. To overcome these challenges, we propose Evolutionary Diffusion-based Neural Architecture Generation (EDNAG), a novel approach that achieves efficient and training-free architecture generation. EDNAG leverages evolutionary algorithms to simulate the denoising process in diffusion models, using fitness to guide the transition from random Gaussian distributions to optimal architecture distributions. This approach combines the strengths of evolutionary strategies and diffusion models, enabling rapid and effective architecture generation. Extensive experiments demonstrate that EDNAG achieves state-of-the-art (SOTA) performance in architecture optimization, with an improvement in accuracy of up to 10.45%. Furthermore, it eliminates the need for time-consuming training and boosts inference speed by an average of 50 times, showcasing its exceptional efficiency and effectiveness.

神经架构生成扩散模型进化算法高效设计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。