arXiv:2601.02997cs.LGcs.CV2026-01被引 14

让大模型通过迭代反馈自主设计新神经网络,提升生成质量与多样性。

From Memorization to Creativity: LLM as a Designer of Novel Neural Architectures

  • 用代码生成+执行反馈闭环训练大模型,逐步掌握有效架构规律。
  • 在CIFAR-10上有效生成率超50%,准确率从28.1%升至51.0%。
  • 生成的455个新架构未出现在原始数据中,适合架构搜索与自动化设计。

大语言模型在程序合成方面表现优异,但在神经网络架构设计——兼顾语法正确性、性能与结构新颖性——方面仍待探索。本文提出基于NNGPT框架的闭环架构生成流程,通过22次监督微调周期,使以代码为导向的LLM持续演化。每轮中,模型生成PyTorch卷积网络,经低精度性能信号验证,并通过MinHash-Jaccard准则过滤重复结构后纳入LEMUR数据集。高性能且新颖的候选架构被转化为提示-代码对,用于参数高效的LoRA微调。该反馈循环驱动显著分布变化,使有效且高性能输出从稀少变为主导。在CIFAR-10上,有效生成率稳定于50.6%(峰值74.5%),首轮准确率由28.1%升至51.0%,准确率超40%的样本占比从2.0%增至96.8%。跨数据集迁移至CIFAR-100和SVHN验证了有效性、准确率分布转移及持续新颖性的泛化能力。22轮中共有455个原始语料外的独特架构通过新颖性过滤。通过执行反馈与新颖性过滤相结合,证明迭代自监督微调可将LLM重塑为任务专用的架构先验,提升生成可靠性、代理性能与结构多样性,提供一种可复现、无需标注的替代手写搜索空间的方法。

原文摘要 · Abstract (English)

Large language models (LLMs) excel in program synthesis, yet their capacity for neural architecture design -- balancing syntactic reliability, performance, and structural novelty -- remains underexplored. We present a closed-loop architecture synthesis pipeline within the NNGPT framework, in which a code-oriented LLM evolves over 22 supervised fine-tuning cycles. At each cycle, the LLM synthesizes PyTorch convolutional networks, validated via low-fidelity performance signals and filtered via a MinHash--Jaccard criterion to prevent structural redundancy before being incorporated into the LEMUR dataset. High-performing candidates with novel architectures are converted into prompt--code pairs for parameter-efficient LoRA fine-tuning. This feedback loop drives a measurable distributional shift, progressively internalizing empirical architectural priors such that valid and high-performing outputs evolve from scarce to dominant across cycles. On CIFAR-10, the valid generation rate stabilizes at 50.6% (peaking at 74.5%), mean first-epoch accuracy rises from 28.1% to 51.0%, and candidates exceeding 40% accuracy grow from 2.0% to 96.8%. Cross-dataset transfer to CIFAR-100 and SVHN confirms that improved validity, shifted accuracy distributions, and sustained novelty generalize across benchmarks of varying difficulty and visual domain. Across 22 cycles, 455 unique architectures absent from the original corpus are admitted under the novelty filter. By grounding synthesis in execution feedback and novelty filtering, we demonstrate that iterative self-supervised fine-tuning reshapes an LLM into a task-specialized architectural prior -- improving generation reliability, proxy performance, and structural diversity -- offering a reproducible, annotation-free alternative to hand-crafted search spaces.

神经网络设计大模型应用架构搜索自监督学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。