用大模型生成架构种子,自动构建可搜索的模块化空间,实现高效跨任务设计。
Agentic Neural Architecture Search

- 大模型生成初始架构并拆解为可替换模块的骨架,自动生成适配任务的搜索空间。
- 在17个任务中11个达新纪录,优于专用专家设计和独立大模型生成结果。
- 适用于需要快速适配新任务的场景,尤其适合缺乏领域经验的研究者。
神经架构搜索(NAS)方法虽日益高效,但仍受限于需大量领域知识的手动设计搜索空间,且每项新任务都需重新构建。大语言模型(LLM)可生成开放空间中的架构,但如何最优分配大模型设计与传统NAS搜索的分工仍未知。本文提出一种机制:由大模型生成高质量初始架构,并将其分解为“插槽架构”——一个包含命名可互换模块槽的结构框架,自动定义出有界、任务特定的搜索空间,无需人工设计。我们基于此构建了AgentNAS,一个模块化的三阶段流程,各组件贡献可独立评估。在涵盖分类、密集回归、分割和多标签标注的17个任务上(使用NAS-Bench-360和Unseen NAS数据集),AgentNAS在11个任务上达到新最优性能,超越已有基线,包括针对特定任务的专家设计。消融实验表明两种搜索机制具有广泛互补性:大模型生成的初始架构已超过多数任务的现有基线,而传统NAS通过槽位间的组合重构带来额外增益,这是独立大模型样本无法复制的模式。该规律在三种不同能力的大模型上均成立,证明分工策略稳健可靠。代码已开源。
原文摘要 · Abstract (English)
Neural architecture search (NAS) methods have grown increasingly efficient, yet they remain bounded by manually engineered search spaces that require substantial domain expertise and must be rebuilt for every new task. Large language models (LLMs) can generate architectures in an open-ended space, but how to optimally divide the labor between LLM-driven design and NAS-driven search remains unexplored. We propose a mechanism that bridges these two paradigms: an LLM produces a high-quality seed architecture, then decomposes it into a "slotted architecture", a scaffold with named, interchangeable module slots that automatically defines a bounded, task-specific search space for conventional NAS to explore, without manual engineering. We instantiate this mechanism in AgentNAS, a modular three-phase pipeline in which each component's contribution can be measured independently. On 17 tasks spanning classification, dense regression, segmentation, and multi-label tagging across diverse modalities (NAS-Bench-360 and Unseen NAS), AgentNAS establishes a new state of the art on 11 tasks, outperforming published baselines including task-specific expert designs. Ablation studies show that the two search mechanisms are broadly complementary: the LLM-generated seed already surpasses published baselines on the majority of tasks, and NAS delivers additional gains in most cases through combinatorial recombination across slots, a mode of search that independent LLM samples cannot replicate. These patterns hold across three LLMs of different capability levels, confirming that the division of labor is robust. Our code is available at https://github.com/alroimfebruary/AgentNAS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。