arXiv:2509.26037cs.AIcs.CV2025-09中稿 · CVPR被引 6

用两个协作大模型高效搜索最优神经网络结构,效果超现有方法。

CoLLM-NAS: Collaborative Large Language Models for Efficient Knowledge-Guided Neural Architecture Search

  • 两阶段框架:导航模型指方向,生成模型造结构,协调器管流程。
  • 在ImageNet上比现有方法快4到10倍,准确率创纪录。
  • 适配多种网络设计,可提升OFA、SPOS等主流方法性能。

将大语言模型(LLM)与神经架构搜索(NAS)结合,为自动化神经网络设计带来新可能。然而,现有方法普遍存在结构无效、计算效率低、性能不佳等问题。本文提出协同式大模型驱动的神经架构搜索(CoLLM-NAS),采用两阶段框架,由两个互补的LLM协同工作:有状态的导航模型引导搜索方向,无状态的生成模型合成高质量候选结构,协调模块管理跨模型通信与评估流程。CoLLM-NAS通过融合LLM对结构化网络的先验知识,以及迭代反馈和历史轨迹带来的渐进知识,高效指导搜索过程。在ImageNet和NAS-Bench-201上的实验表明,CoLLM-NAS超越现有NAS方法及传统搜索算法,在保持新纪录性能的同时,将搜索成本降低4至10倍。此外,它在多种搜索空间(如MobileNet、ShuffleNet、AutoFormer)中持续提升OFA、SPOS、AutoFormer等两阶段NAS方法的性能与效率,展现出卓越泛化能力。

原文摘要 · Abstract (English)

The integration of Large Language Models (LLMs) with Neural Architecture Search (NAS) has introduced new possibilities for automating the design of neural architectures. However, most existing methods face critical limitations, including architectural invalidity, computational inefficiency, and inferior performance compared to traditional NAS. In this work, we present Collaborative LLM-based NAS (CoLLM-NAS), a two-stage NAS framework with knowledge-guided search driven by two complementary LLMs. Specifically, we propose a stateful Navigator LLM to guide search direction, a stateless Generator LLM to synthesize high-quality candidates, and a Coordinator module to orchestrate inter-LLM communication and manage evaluation processes. CoLLM-NAS efficiently guides the search process by combining LLMs' inherent knowledge of structured neural architectures with progressive knowledge from iterative feedback and historical trajectory. Experimental results on ImageNet and NAS-Bench-201 show that CoLLM-NAS surpasses existing NAS methods and conventional search algorithms, achieving new state-of-the-art results while significantly reducing search costs by 4--10. Furthermore, CoLLM-NAS consistently enhances the performance and efficiency of various two-stage NAS methods (e.g., OFA, SPOS, and AutoFormer) across diverse search spaces (e.g., MobileNet, ShuffleNet, and AutoFormer), demonstrating its excellent generalization.

神经架构搜索大模型应用高效搜索协同学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。