arXiv:2511.20333cs.AIcs.LG2025-11被引 18

用大模型自动设计神经网络,持续自我优化,提升视觉模型开发效率。

NNGPT: Rethinking AutoML with Large Language Models

  • 用大模型生成新网络架构,闭环迭代优化,实现自进化。
  • 单次提示即可生成可执行模型,代码预测误差仅0.14,性能超Optuna。
  • 支持零样本架构设计与代码级纠错,适合自动化研发团队使用。

构建自改进的AI系统仍是人工智能领域的核心挑战。我们提出NNGPT,一个开源框架,将大语言模型(LLM)转化为用于神经网络开发(主要面向计算机视觉)的自改进自动化机器学习(AutoML)引擎。与以往框架不同,NNGPT通过生成新模型扩展神经网络数据集,建立基于生成、评估与自改进的闭环系统。它在统一工作流中集成五个协同的LLM管道:零样本架构合成、超参数优化(HPO)、代码感知的精度/早停预测、检索增强的范围封闭式PyTorch模块合成(NN-RAG),以及强化学习。基于经过审计的LEMUR数据集,NNGPT能从单一提示生成并验证网络架构、预处理代码与超参数,端到端执行并从中学习。其PyTorch适配器使框架无关,表现强劲:NN-RAG在1,289个目标上达到73%可执行率,3次提示提升常见数据集准确率,哈希去重节省数百次运行。一次预测即达搜索型AutoML水平,减少大量试错。在LEMUR上的HPO实现RMSE 0.60,优于Optuna(0.64);代码感知预测器达RMSE 0.14,皮尔逊相关系数r=0.78。系统已生成超过5,000个验证模型,证明其为自主的AutoML引擎。论文接收后将公开代码、提示与检查点,以支持可复现性与社区使用。

原文摘要 · Abstract (English)

Building self-improving AI systems remains a fundamental challenge in the AI domain. We present NNGPT, an open-source framework that turns a large language model (LLM) into a self-improving AutoML engine for neural network development, primarily for computer vision. Unlike previous frameworks, NNGPT extends the dataset of neural networks by generating new models, enabling continuous fine-tuning of LLMs based on closed-loop system of generation, assessment, and self-improvement. It integrates within one unified workflow five synergistic LLM-based pipelines: zero-shot architecture synthesis, hyperparameter optimization (HPO), code-aware accuracy/early-stop prediction, retrieval-augmented synthesis of scope-closed PyTorch blocks (NN-RAG), and reinforcement learning. Built on the LEMUR dataset as an audited corpus with reproducible metrics, NNGPT emits from a single prompt and validates network architecture, preprocessing code, and hyperparameters, executes them end-to-end, and learns from result. The PyTorch adapter makes NNGPT framework-agnostic, enabling strong performance: NN-RAG achieves 73% executability on 1,289 targets, 3-shot prompting boosts accuracy on common datasets, and hash-based deduplication saves hundreds of runs. One-shot prediction matches search-based AutoML, reducing the need for numerous trials. HPO on LEMUR achieves RMSE 0.60, outperforming Optuna (0.64), while the code-aware predictor reaches RMSE 0.14 with Pearson r=0.78. The system has already generated over 5K validated models, proving NNGPT as an autonomous AutoML engine. Upon acceptance, the code, prompts, and checkpoints will be released for public access to enable reproducibility and facilitate community usage.

AutoML大模型神经网络生成自进化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。