arXiv:2508.10177cs.AI2025-08被引 7

KompeteAI加速自动化机器学习流程生成,提升探索效率与执行速度。

KompeteAI: Accelerated Autonomous Multi-Agent System for End-to-End Pipeline Generation for Machine Learning Problems

  • 引入合并阶段重组优秀候选方案,增强解空间探索多样性。
  • 通过早期指标预测减少代码执行次数,评估速度提升6.9倍。
  • 融合真实案例知识源,适合需要高效端到端建模的开发者。

基于大语言模型的AutoML系统虽表现优异,但受限于探索策略单一及执行瓶颈。现有方法或采用单次生成缺乏多样性,或依赖蒙特卡洛树搜索却无法有效组合部分优解。执行环节因代码验证周期长,阻碍迭代优化。为此,我们提出KompeteAI,一个具备动态解空间探索能力的新型AutoML框架。不同于传统MCTS将思路孤立处理,KompeteAI新增合并阶段,对最优候选方案进行组合。同时,通过检索增强生成(RAG)整合Kaggle笔记与arXiv论文中的实际策略,扩展假设空间。针对执行瓶颈,设计预测评分模型与加速调试方法,利用早期指标评估方案潜力,避免完整代码执行。该方法使管道评估速度提升6.9倍。在主基准MLE-Bench上,KompeteAI平均优于RD-agent、AIDE和Ml-Master等领先方法3%。此外,我们提出Kompete-bench以弥补MLE-Bench的局限性,KompeteAI在此新基准上也达到最先进水平。

原文摘要 · Abstract (English)

Recent Large Language Model (LLM)-based AutoML systems demonstrate impressive capabilities but face significant limitations such as constrained exploration strategies and a severe execution bottleneck. Exploration is hindered by one-shot methods lacking diversity and Monte Carlo Tree Search (MCTS) approaches that fail to recombine strong partial solutions. The execution bottleneck arises from lengthy code validation cycles that stifle iterative refinement. To overcome these challenges, we introduce KompeteAI, a novel AutoML framework with dynamic solution space exploration. Unlike previous MCTS methods that treat ideas in isolation, KompeteAI introduces a merging stage that composes top candidates. We further expand the hypothesis space by integrating Retrieval-Augmented Generation (RAG), sourcing ideas from Kaggle notebooks and arXiv papers to incorporate real-world strategies. KompeteAI also addresses the execution bottleneck via a predictive scoring model and an accelerated debugging method, assessing solution potential using early stage metrics to avoid costly full-code execution. This approach accelerates pipeline evaluation 6.9 times. KompeteAI outperforms leading methods (e.g., RD-agent, AIDE, and Ml-Master) by an average of 3\% on the primary AutoML benchmark, MLE-Bench. Additionally, we propose Kompete-bench to address limitations in MLE-Bench, where KompeteAI also achieves state-of-the-art results

自动化机器学习多智能体系统LLM应用效率优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。