iML让自动机器学习生成可执行代码,更可靠、更贴合数据、探索更广。
iML: Executable, Problem-Grounded, and Broadly Exploratory Code-Driven AutoML
- 多智能体框架生成分模块代码,支持传统模型、预训练适配和自定义网络。
- 在MLE-BENCH上代码有效率90%,奖牌率达45%,性能超越基线52%至273%。
- 适合需要高可靠性与灵活创新的自动机器学习研究者与工程师。
自动化机器学习(AutoML)虽提升了机器学习的可及性,但现有方法在灵活性、透明度和执行可靠性方面仍受限。代码驱动的AutoML通过生成可执行的预处理、训练与评估代码,展现出潜力,但当前基于大语言模型的方法常产生看似合理实则脆弱的代码,缺乏对实际数据的充分依赖,或局限于狭窄解法路径。本文提出iML,一种围绕可执行性、问题贴合性与广泛探索设计的多智能体代码驱动AutoML框架。iML首先分析任务并画像数据,再生成结构化蓝图,引导多个实现路径(传统机器学习、预训练模型微调、自定义神经架构)的模块化代码生成。为提升可靠性,iML在集成过程中引入接口检查、动态执行与迭代调试。我们在MLE-BENCH和新提出的iML-BENCH上进行评估,涵盖多种类似Kaggle的任务。在MLE-BENCH上,iML实现90%的有效提交率、45%奖牌率,平均标准化性能得分(APS)达0.82,较基于LLM的基线提升52%-273%。在iML-BENCH上,iML取得最高APS,且在任务描述严重简化时仍表现稳健。结果表明,iML是可靠且具有竞争力的代码驱动AutoML框架。
原文摘要 · Abstract (English)
Automated Machine Learning (AutoML) has improved access to machine learning, yet existing techniques often remain limited in flexibility, transparency, and execution reliability. Code-driven AutoML offers a promising direction by synthesizing executable code for preprocessing, model training, and evaluation. However, current LLM-based approaches frequently generate code that is plausible in text yet brittle in execution, insufficiently grounded in the actual dataset, or restricted to narrow solution paths. In this paper, we introduce iML, a multi-agent code-driven AutoML framework designed around three requirements: executability, problem grounding, and broad exploration of valid solutions. iML first analyzes the task and profiles the data, then synthesizes a structured blueprint that guides modular code generation across multiple implementation tracks, including traditional ML,pretrained adaptation, and custom neural architectures. To improve reliability, iML enforces interface checking, dynamic execution, and iterative debugging during integration. We evaluate iML on MLE-BENCH and the newly introduced iML-BENCH, covering diverse Kaggle-style tasks. On MLE-BENCH, iML attains a 90% valid submission rate and a 45% medal rate, and an APS of 0.82, improving the average standardized performance score (APS) over the LLM-based baselines by 52%-273%. On iML-BENCH, it achieves the highest APS and demonstrates robust performance even when task descriptions are substantially stripped. These results establish iML as a reliable and competitive framework for code-driven AutoML.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。