AI用AI设计AI,通过记忆机制融合探索与推理,效率更高。
ML-Master: Towards AI-for-AI via Integration of Exploration and Reasoning
- 用选择性记忆整合多条解题路径的洞察,结合推理指导下一步探索。
- 在MLE-Bench上平均获奖率29.3%,中等复杂任务表现显著优于已有方法。
- 12小时内完成任务,仅用对手一半时间,适合高效自动化AI开发场景。
随着AI能力逼近甚至超越人类水平,由AI驱动的开发正逐步取代传统人力主导模式。实现这一转变的关键路径是AI for AI(AI4AI),即利用AI技术自动优化AI系统的架构设计、训练与部署。尽管基于大语言模型的智能体已展现出构建AI4AI的潜力,但其往往无法充分利用探索过程中积累的经验,导致效率低下与性能不足。为此,我们提出ML-Master,一种将探索与推理无缝融合的新型AI4AI智能体,通过选择性范围记忆机制,高效整合并行解题轨迹中的多样化洞察,并以分析推理引导后续探索,避免信息过载。我们在MLE-Bench上评估了ML-Master,其平均奖牌率达29.3%,显著优于现有方法,尤其在中等复杂度任务中表现突出,且在严格的12小时时限内完成,仅为先前基线所用24小时的一半。结果表明,ML-Master具备推动AI4AI发展的强大潜力。
原文摘要 · Abstract (English)
As AI capabilities advance toward and potentially beyond human-level performance, a natural transition emerges where AI-driven development becomes more efficient than human-centric approaches. A promising pathway toward this transition lies in AI-for-AI (AI4AI), which leverages AI techniques to automate and optimize the design, training, and deployment of AI systems themselves. While LLM-based agents have shown the potential to realize AI4AI, they are often unable to fully leverage the experience accumulated by agents during the exploration of solutions in the reasoning process, leading to inefficiencies and suboptimal performance. To address this limitation, we propose ML-Master, a novel AI4AI agent that seamlessly integrates exploration and reasoning by employing a selectively scoped memory mechanism. This approach allows ML-Master to efficiently combine diverse insights from parallel solution trajectories with analytical reasoning, guiding further exploration without overwhelming the agent with excessive context. We evaluate ML-Master on the MLE-Bench, where it achieves a 29.3% average medal rate, significantly surpassing existing methods, particularly in medium-complexity tasks, while accomplishing this superior performance within a strict 12-hour time constraint-half the 24-hour limit used by previous baselines. These results demonstrate ML-Master's potential as a powerful tool for advancing AI4AI.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。