用树结构让LLM辅助搜索神经网络,突破传统生成局限
LLM as a Tool, Not an Agent: Code-Mined Tree Transformations for Neural Architecture Search

- 将代码提取为可演化树结构,通过可靠变换代替直接生成
- 在CIFAR-10/100/ImageNet上分别提升0.69/1.83/2.68分
- 适合追求高效探索与可执行架构的NAS研究者
神经架构搜索(NAS)旨在自动发现高性能深度神经网络(DNN)架构。传统算法驱动的NAS依赖精心设计的搜索空间以保证可执行性,限制了开放探索。近期基于代码的代理式方法使用大语言模型(LLMs)减少人工设计,但当前LLM难以稳定生成复杂有效架构,且其提议常受训练数据中少量模式的偏差影响。为融合可靠算法搜索与强大LLM辅助,我们提出LLMasTool,一种分层树状NAS框架,实现稳定且开放的模型演化。该方法自动从任意源代码中提取可复用模块,并将完整架构表示为分层树,通过可靠的树变换实现演化,而非代码生成。每一步演化中,粗粒度规划由多样性引导的算法控制,利用贝叶斯建模提升探索效率;而LLM负责解决剩余自由度,确保演化路径有意义且生成的架构可执行。与完全代理式LLM方法不同,本方法能探索超出LLM固有偏见的多样化方向。在CIFAR-10、CIFAR-100和ImageNet16-120上,性能分别优于现有方法0.69、1.83和2.68分,验证了有效性。
原文摘要 · Abstract (English)
Neural Architecture Search (NAS) aims to automatically discover high-performing deep neural network (DNN) architectures. However, conventional algorithm-driven NAS relies on carefully hand-crafted search spaces to ensure executability, which restricts open-ended exploration. Recent coding-based agentic approaches using large language models (LLMs) reduce manual design, but current LLMs struggle to reliably generate complex, valid architectures, and their proposals are often biased toward a narrow set of patterns observed in their training data. To bridge reliable algorithmic search with powerful LLM assistance, we propose LLMasTool, a hierarchical tree-based NAS framework for stable and open-ended model evolution. Our method automatically extracts reusable modules from arbitrary source code and represents full architectures as hierarchical trees, enabling evolution through reliable tree transformations rather than code generation. At each evolution step, coarse-level planning is governed by a diversity-guided algorithm that leverages Bayesian modeling to improve exploration efficiency, while the LLM resolves the remaining degrees of freedom to ensure a meaningful evolutionary trajectory and an executable generated architecture. With this formulation, instead of fully agentic LLM approaches, our method explores diverse directions beyond the inherent biases in the LLM. Our method improves over existing NAS methods by 0.69, 1.83, and 2.68 points on CIFAR-10, CIFAR-100, and ImageNet16-120, demonstrating its effectiveness.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。