arXiv:2512.24120cs.CVcs.AI2025-12被引 13

用少样本提示+快速去重,让大模型高效生成视觉网络架构

Enhancing LLM-Based Neural Network Generation: Few-Shot Prompting and Efficient Validation for Automated Architecture Design

  • 采用1-6个样例的少样本提示,发现3个样例最平衡
  • 提出空白标准化哈希去重,速度提升100倍且仅需1毫秒
  • 在7个数据集生成1900个唯一架构,适合算力有限的研究者

自动化神经网络架构设计在计算机视觉中仍具挑战性。任务多样性与计算约束要求既高效又有效的架构与搜索方法。大型语言模型(LLMs)为计算密集型神经架构搜索(NAS)提供了有前景的替代方案,但其在计算机视觉中的架构生成应用尚未系统研究,尤其缺乏对提示工程与验证策略的探索。基于任务无关的NNGPT/LEMUR框架,本文引入并验证了两项关键贡献:首先,提出少样本架构提示(FSAP),首次系统研究支持样例数量(n = 1, 2, 3, 4, 5, 6)对基于LLM架构生成的影响。结果表明,使用n = 3个样例在架构多样性和上下文聚焦间达到最佳平衡。其次,提出空白标准化哈希验证(Whitespace-Normalized Hash Validation),一种轻量级去重方法(耗时低于1毫秒),相比AST解析提速100倍,并防止重复训练相同架构。在七个计算机视觉基准(MNIST、CIFAR-10、CIFAR-100、CelebA、ImageNette、SVHN、Places365)的大规模实验中,共生成1,900个唯一架构。此外,提出数据集平衡评估方法,以应对跨异构视觉任务的架构比较难题。这些贡献为基于LLM的视觉架构搜索提供可操作指南,并建立严谨评估范式,使计算资源有限的研究者也能更易开展自动化设计。

原文摘要 · Abstract (English)

Automated neural network architecture design remains a significant challenge in computer vision. Task diversity and computational constraints require both effective architectures and efficient search methods. Large Language Models (LLMs) present a promising alternative to computationally intensive Neural Architecture Search (NAS), but their application to architecture generation in computer vision has not been systematically studied, particularly regarding prompt engineering and validation strategies. Building on the task-agnostic NNGPT/LEMUR framework, this work introduces and validates two key contributions for computer vision. First, we present Few-Shot Architecture Prompting (FSAP), the first systematic study of the number of supporting examples (n = 1, 2, 3, 4, 5, 6) for LLM-based architecture generation. We find that using n = 3 examples best balances architectural diversity and context focus for vision tasks. Second, we introduce Whitespace-Normalized Hash Validation, a lightweight deduplication method (less than 1 ms) that provides a 100x speedup over AST parsing and prevents redundant training of duplicate computer vision architectures. In large-scale experiments across seven computer vision benchmarks (MNIST, CIFAR-10, CIFAR-100, CelebA, ImageNette, SVHN, Places365), we generated 1,900 unique architectures. We also introduce a dataset-balanced evaluation methodology to address the challenge of comparing architectures across heterogeneous vision tasks. These contributions provide actionable guidelines for LLM-based architecture search in computer vision and establish rigorous evaluation practices, making automated design more accessible to researchers with limited computational resources.

架构生成大模型高效搜索去重

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。