arXiv:2511.03985cs.AI2025-11

用多智能体协作减少训练次数,加速模型架构搜索。

ArchPilot: A Proxy-Guided Multi-Agent Approach for Machine Learning Engineering

  • 三智能体分工:调度、生成、代理评估,协同优化架构设计。
  • 仅需少量全量训练,在MLE-Bench上超越AIDE和ML-Master性能。
  • 适合资源有限但需高效探索大规模模型空间的研究者。

近期基于大语言模型的智能体在自动化机器学习工程中展现出强大能力,但其严重依赖重复的完整训练来评估候选方案,导致显著的计算开销,难以扩展至大规模搜索空间,且迭代速度慢。为解决这些问题,我们提出ArchPilot,一个整合架构生成、基于代理的评估与自适应搜索的多智能体系统。ArchPilot包含三个专用智能体:协调智能体采用受蒙特卡洛树搜索启发的新型算法并带重启机制,管理历史候选记忆;生成智能体迭代生成、优化并调试候选架构;评估智能体执行代理训练,生成并优化代理函数,将代理得分聚合为保真度感知的性能指标。该多智能体协作使ArchPilot能以极少全量训练优先高潜力候选方案,实现受限预算下的高效机器学习工程。在MLE-Bench上的实验表明,ArchPilot优于AIDE和ML-Master等当前最优基线。

原文摘要 · Abstract (English)

Recent LLM-based agents have demonstrated strong capabilities in automated ML engineering. However, they heavily rely on repeated full training runs to evaluate candidate solutions, resulting in significant computational overhead, limited scalability to large search spaces, and slow iteration cycles. To address these challenges, we introduce ArchPilot, a multi-agent system that integrates architecture generation, proxy-based evaluation, and adaptive search into a unified framework. ArchPilot consists of three specialized agents: an orchestration agent that coordinates the search process using a Monte Carlo Tree Search (MCTS)-inspired novel algorithm with a restart mechanism and manages memory of previous candidates; a generation agent that iteratively generates, improves, and debugs candidate architectures; and an evaluation agent that executes proxy training runs, generates and optimizes proxy functions, and aggregates the proxy scores into a fidelity-aware performance metric. This multi-agent collaboration allows ArchPilot to prioritize high-potential candidates with minimal reliance on expensive full training runs, facilitating efficient ML engineering under limited budgets. Experiments on MLE-Bench demonstrate that ArchPilot outperforms SOTA baselines such as AIDE and ML-Master, validating the effectiveness of our multi-agent system.

自动机器学习多智能体架构搜索代理评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。