arXiv:2601.08517cs.CV2026-01被引 11

用大模型自动发现视觉模型中非标准的通道配置

Closed-Loop LLM Discovery of Non-Standard Channel Priors in Vision Models

  • 让大模型通过反馈循环生成并优化网络通道结构
  • 在CIFAR-100上优于初始架构,发现非标准通道设计
  • 适合想探索代码级神经网络设计的开发者

通道配置搜索是深度神经网络中优化层结构(如通道数)的组合难题,受限于张量形状兼容性和计算预算。本文研究大语言模型(LLM)能否通过理解代码结构来辅助神经网络架构搜索(NAS),补充传统启发式方法。提出一种基于LLM的闭环搜索框架,将任务建模为条件代码生成:LLM根据性能反馈逐步优化架构。为解决数据稀缺问题,通过抽象语法树(AST)变异生成大量合法且形状一致的架构,虽不保证性能最优,但提供可执行的设计模式,帮助LLM学习通道配置与性能的关系。在CIFAR-100上的实验表明,该框架在相同代理评估协议下优于初始生成的架构。分析显示,生成的架构体现出特定领域设计模式,如非标准通道宽度和后期扩张。代码与提示已公开于https://github.com/ABrain-One/NN-GPT,生成的网络发布于https://github.com/ABrain-One/NN-Dataset,模型名以ast-dimension-为前缀。

原文摘要 · Abstract (English)

Channel-configuration search, the optimization of layer specifications such as channel widths in deep neural networks, presents a combinatorial challenge constrained by tensor-shape compatibility and computational budgets. We investigate whether large language models (LLMs) can support neural architecture search (NAS) by reasoning over architectural code structures in ways that complement traditional search heuristics. We apply an LLM-driven NAS framework to channel-configuration search, formulating the task as conditional code generation in which the LLM refines architectural specifications using performance feedback. To address data scarcity, we generate a corpus of valid, shape-consistent architectures through abstract syntax tree (AST) mutations. Although these mutated networks are not necessarily optimized for performance, they provide structural examples that help the LLM learn executable architectural patterns and relate channel configurations to model performance. Experimental results on CIFAR-100 show that the closed-loop LLM improves upon the initial AST-generated architecture population under the same proxy-evaluation protocol. Our analysis further shows that the generated architectures reflect domain-specific design patterns, including non-standard channel widths and late-stage expansion, highlighting the potential of language-driven design for code-level NAS. The code and prompts are publicly available at https://github.com/ABrain-One/NN-GPT, and the generated deep neural networks are published at https://github.com/ABrain-One/NN-Dataset under model names with the prefix ast-dimension-.

神经网络架构搜索大模型应用代码生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。